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PREFACE 


The great advancements in the design of microchips, digital systems, and computer hardware over 
the past 40 years have given birth to digital signal processing (DSP) which has grown over the 
years into a ubiquitous, multifaceted, and indispensable subject of study. As such DSP has been 
applied in most disciplines ranging from engineering to economics and from astronomy to molecular 
biology. Consequently, it would take a multivolume encyclopedia to cover all the facets, aspects, and 
ramifications of DSP, and such a treatise would require many authors. This textbook focuses instead 
on the fundamentals of DSP, namely, on the representation of signals by mathematical models and 
on the processing of signals by discrete-time systems. Various types of processing are possible for 
signals but the processing of interest in this volume is almost always linear and it typically involves 
reshaping, transforming, or manipulating the frequency spectrum of the signal of interest. Discrete¬ 
time systems that can reshape, transform, or manipulate the spectrum of a signal are known as digital 
filters, and these systems will receive very special attention as they did in the author’s previous 
textbook Digital Filters: Analysis, Design, and Applications, McGraw-Hill, 1993. 

This author considers the processing of continuous- and discrete-time signals to be different 
facets of one and the same subject of study without a clear demarcation where the processing of 
continuous-time signals by analog systems ends and the processing of discrete-time signals by digital 
systems begins. Discrete-time signals sometimes exist as distinct entities that are not derived from 
or related to corresponding continuous-time signals. The processing of such a signal would result 
in a transformed discrete-time signal, which would be, presumably, an enhanced or in some way 
more desirable version of the original signal. Obviously, reference to an underlying continuous¬ 
time signal would be irrelevant in such a case. However, more often than not discrete-time signals 
are derived from corresponding continuous-time signals and, as a result, they inherit the spectral 
characteristics of the latter. Discrete-time signals of this type are often processed by digital systems 
and after that they are converted back to continuous-time signals. A case in point can be found 
in the recording industry where music is first sampled to generate a discrete-time signal which is 
then recorded on a CD. When the CD is played back, the discrete-time signal is converted into a 
continuous-time signal. In order to preserve the spectrum of the underlying continuous-time signal, 
e.g., that delightful piece of music, through this series of signal manipulations, special attention must 
be paid to the spectral relationships that exist between continuous- and discrete-time signals. These 
relationships are examined in great detail in Chapters 6 and 7. In the application just described, part 
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of the processing must be performed by analog filters. As will be shown in Chapter 6, there is often 
a need to use a bandlimiting analog filter before sampling and, on the other hand, the continuous¬ 
time signal we hear through our stereo systems is produced by yet another analog filter. Therefore, 
knowledge of analog filters is prerequisite if we are called upon to design DSP systems that involve 
continuous-time signals in some way. Knowledge of analog filters is crucial in another respect: some 
of the better recursive digital filters can be designed only by converting analog into digital filters, as 
will be shown in Chapters 10-12 and 17. 

The prerequisite knowledge for the book is a typical undergraduate mathematics background 
of calculus, complex analysis, and simple differential equations. At certain universities, complex 
analysis may not be included in the curriculum. To overcome this difficulty, the basics of complex 
analysis are summarized in Appendix A which can also serve as a quick reference or refresher. The 
derivation of the elliptic approximation in Section 10.6 requires a basic understanding of elliptic 
functions but it can be skipped by most readers. Since elliptic functions are not normally included in 
undergraduate curricula, a brief but adequate treatment of these functions is included in Appendix 
B for the sake of completeness. Chapter 14 requires a basic understanding of random variables and 
processes which may not be part of the curriculum at certain universities. To circumvent this difficulty, 
the prerequisite knowledge on random variables and processes is summarized in Chapter 13. 

Chapter 1 provides an overview of DSP. It starts with a classification of the types of signals 
encountered in DSP. It then introduces in a heuristic way the characterization of signals in terms of 
frequency spectrums. The filtering process as a means of transforming or altering the spectrum of 
a signal is then described. The second half of the chapter provides a historical perspective of the 
evolution of analog and digital filters and their applications. The chapter concludes with two specific 
applications that illustrate the scope, diversity, and usefulness of DSP. 

Chapter 2 describes the Fourier series and Fourier transform as the principal mathematical 
entities for the spectral characterization of continuous-time signals. The Fourier transform is deduced 
from the Fourier series through a limiting process whereby the period of a periodic signal is stretched 
to infinity. 

The most important mathematical tool for the representation of discrete-time signals is the 
z transform and this forms the subject matter of Chapter 3. The z transform is viewed as a Laurent 
series and that immediately causes the z transform to inherit the mathematical properties of the Lau¬ 
rent series. By this means, the convergence properties of the z transform are more clearly understood 
and, furthermore, a host of algebraic techniques become immediately applicable in the inversion 
of the z transform. The chapter also deals with the use of the z transform as a tool for the spectral 
representation of discrete-time signals. 

Chapter 4 deals with the fundamentals of discrete-time systems. Topics considered include 
basic system properties such as linearity, time invariance, causality, and stability; characterization of 
discrete-time systems by difference equations; representation by networks and signal flow graphs and 
analysis by node-elimination techniques. Time-domain analysis is introduced at an elementary level. 
The analysis is accomplished by solving the difference equation of the system by using induction. 
Although induction is not known for its efficiency, it is an intuitive technique that provides the 
newcomer with a clear understanding of the basics of discrete-time systems and how they operate, 
e.g., what are initial conditions, what is a transient or steady-state response, what is an impulse 
response, and so on. The chapter continues with the representation of discrete-time systems by 
convolution summations on the one hand and by state-space characterizations on the other. 
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The application of the z transform to discrete-time systems is covered in Chapter 5. By applying 
the z transform to the convolution summation, a discrete-time system can be represented by a transfer 
function that encapsulates all the linear properties of the system, e.g., time-domain response, stability, 
steady-state sinusoidal response, and frequency response. The chapter also includes stability criteria 
and algorithms that can be used to decide with minimal computational effort whether a discrete¬ 
time system is stable or not. The concepts of amplitude and phase responses and their physical 
significance are illustrated by examples as well as by two- and three-dimensional MATLAB plots 
that show clearly the true nature of zeros and poles. Chapter 5 also delineates the standard first- and 
second-order transfer functions that can be used to design lowpass, highpass, bandpass, bandstop, 
and allpass digital filters. The chapter concludes with a discussion on the causes and elimination of 
signal distortion in discrete-time systems such as amplitude distortion and delay distortion. 

Chapter 6 extends the application of the Fourier transform to impulse and periodic signals. 
It also introduces the class of impulse-modulated signals which are, in effect, both sampled and 
continuous in time. As such, they share characteristics with both continuous- as well as discrete-time 
signals. Therefore, these signals provide a bridge between the analog and digital worlds and thereby 
facilitate the DSP practitioner to interrelate the spectral characteristics of discrete-time signals with 
those of the continuous-time signals from which they were derived. The chapter also deals with the 
sampling process, the use of digital filters for the processing of continuous-time signals, and the 
characterization and imperfections of analog-to-digital and digital-to-analog converters. 

Chapter 7 presents the discrete Fourier transform (DFT) and the associated fast Fourier- 
transform method as mathematical tools for the analysis of signals on the one hand and for the software 
implementation of digital filters on the other. The chapter starts with the definition and properties of 
the DFT and continues with the interrelations that exist between the DFT and (1) the z transform, 
(2) the continuous Fourier transform, and (3) the Fourier series. These interrelations must be thor¬ 
oughly understood, otherwise the user of the fast Fourier-transform method is likely to end up with 
inaccurate spectral representations for the signals of interest. The chapter also deals with the window 
method in detail, which can facilitate the processing of signals of long or infinity duration. 

Chapters 1 to 7 deal, in effect, with the characterization and properties of continuous- and 
discrete-time, periodic and nonperiodic signals, and with the general properties of discrete-time 
systems in general. Chapters 8 to 18, on the other hand, are concerned with the design of various 
types of digital filters. The design process is deemed to comprise four steps, namely, approximation, 
realization, implementation, and study of system imperfections brought about by the use of finite 
arithmetic. Approximation is the process of generating a transfer function that would satisfy the 
required specifications. Realization is the process of converting the transfer function or some other 
characterization of the digital filter into a digital network or structure. Implementation can take 
two forms, namely, software and hardware. In a software implementation, a difference equation or 
state-space representation is converted into a computer program that simulates the performance of 
the digital filter, whereas in a hardware implementation a digital network is converted into a piece 
of dedicated hardware. System imperfections are almost always related to the use of finite-precision 
ar ithmetic and manifest themselves as numerical errors in filter parameters or the values of the signals 
being processed. 

Although the design process always starts with the solution of the approximation problem, the 
realization process is much easier to deal with and for this reason it is treated first in Chapter 8. As 
will be shown, several realization methods are available that lead to a great variety of digital-filter 
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structures. Chapter 8 also deals with a special class of structures known as systolic structures which 
happen to have some special properties that make them amenable to integrated-circuit implementa¬ 
tion. 

Chapter 9 is concerned with closed-form methods that can be used to design nonrecursive 
filters. The chapter starts by showing that constant-delay (linear-phase) nonrecursive filters can be 
easily designed by forcing certain symmetries on the impulse response. The design of such filters 
through the use of the Fourier series in conjunction with the window method is then described. Several 
of the standard window functions, including the Dolph-Chebyshev and Kaiser window functions, 
and their interrelations are detailed. The chapter includes a step-by-step design procedure based on 
the Kaiser window function that can be used to design standard nonrecursive filters that would satisfy 
prescribed specifications. It concludes with a method based on the use of classical numerical analysis 
formulas which can be used to design specialized nonrecursive filters that can perform interpolation, 
differentiation, and integration. 

The approximation problem for recursive filters can be solved by using direct or indirect 
methods. In direct methods, the discrete-time transfer function is obtained directly in the z do¬ 
main usually through iterative optimization methods. In indirect methods, on the other hand, the 
discrete-time transfer function is obtained by converting the continuous-time transfer function of an 
appropriate analog filter through a series of transformations. Thus the need arises for the solution of 
the approximation problem in analog filters. The basic concepts pertaining to the characterization of 
analog filters and the standard approximation methods used to design analog lowpass filters, i.e,, the 
Butterworth, Chebyshev, inverse-Chebyshev, elliptic, and Bessel-Thomson methods, are described 
in detail in Chapter 10. The chapter concludes with certain classical transformations that can be 
used to convert a given lowpass approximation into a corresponding highpass, bandpass, or bandstop 
approximation. 

Chapter 11 deals with the approximation problem for recursive digital filters. Methods are 
described by which a given continuous-time transfer function can be transformed into a corresponding 
discrete-time transfer function, e.g., the invariant impulse-response, matched-’ transformation, and 
bilinear-transformation methods. The chapter concludes with certain transformations that can be used 
to convert a given lowpass digital filter into a corresponding highpass, bandpass, or bandstop digital 
filter. A detailed procedure that can be used to design Butterworth, Chebyshev, inverse-Chebyshev, 
and elliptic filters that would satisfy prescribed specifications, with design examples, is found in 
Chapter 12. 

The basics of random variables and the extension of these principles to random processes as a 
means of representing random signals are introduced in Chapter 13. Random variables and signals 
arise naturally in digital filters because of the inevitable quantization of filter coefficients and signal 
values. The effects of finite word length in digital filters along with relevant up-to-date methods of 
analysis are discussed in Chapter 14. The topics considered include coefficient quantization and 
methods to reduce its effects; signal scaling; product quantization and methods to reduce its effects; 
parasitic and overflow limit-cycle oscillations and methods to eliminate them. 

Chapters 15 and 16 deal with the solution of the approximation problem using iterative op¬ 
timization methods. Chapter 15 describes a number of efficient algorithms based on the Remez 
exchange algorithm that can be used to design nonrecursive filters of the standard types, e.g., low- 
pass, highpass, bandpass, and bandstop filters, and also specialized filters, e.g., filters with arbitrary 
amplitude responses, multiband filters, and digital differentiators. Chapter 16, on the other hand, 
considers the design of recursive digital filters by optimization. To render this material accessible to 
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the reader who has not had the opportunity to study optimization before, a series of progressively 
improved but related algorithms is presented starting with the classical Newton algorithm for convex 
problems and culminating in a fairly sophisticated, practical, and efficient quasi-Newton algorithm 
that can be used to design digital filters with arbitrary frequency responses. Chapter 16 also deals 
with the design of recursive equalizers which are often used to achieve a linear phase response in a 
recursive filter. 

Chapter 17 is in effect a continuation of Chapter 8 and it deals with the realization of digital 
filters in the form of wave digital filters. These structures are derived from classical analog filters and, 
in consequence, they have certain attractive features, such as low sensitivity to numerical errors, which 
make them quite attractive for certain applications. The chapter includes step-by-step procedures by 
which wave digital filters satisfying prescribed specifications can be designed either in ladder or 
lattice form. The chapter concludes with a list of guidelines that can be used to choose a digital-filter 
structure from the numerous possibilities described in Chapters 8 and 12. 

Chapter 18 deals with some of the numerous applications of digital filters to digital signal 
processing. The applications considered include downsampling and upsampling using decimators 
and interpolators, the design of quadrature-mirror-image filters and their application in time-division 
to frequency-division multiplex translation, Hilbert transformers and their application in single¬ 
sideband modulation, adaptive filters, and two-dimensional digital filters. 

The purpose of Appendix A is twofold. First, it can be regarded as a brief review of complex 
analysis for readers who have not had the opportunity to take a course on this important subject. 
Second, it can serve as a reference monograph that brings together those principles of complex 
analysis that are required for DSP. Appendix B, on the other hand, presents the basic principles of 
elliptic integrals and functions and its principal purpose is to facilitate the derivation of the elliptic 
approximation in Chapter 10. 

The book can serve as a text for undergraduate or graduate courses and various scenarios are 
possible depending on the background preparation of the class and the curriculum of the institution. 
Some possibilities are as follows: 

• Series of Two Undergraduate Courses. First-level course: Chapters 1 to 7, second-level course: 
Chapters 8 to 14 

• Series of Two Graduate Courses. First-level course: Chapters 5 to 12, second-level course: 
Chapters 13 to 18 

• One Undergraduate/Graduate Course. Assuming that the students have already taken relevant 
courses on signal analysis and system theory, a one-semester course could be offered comprising 
Chapters 5 to 12 and parts of Chapter 14. 

The book is supported by the author’s DSP software package D-Filter which can be used to 
analyze, design, and realize digital filters, and to analyze discrete-time signals. See D-Filter page 
at the end of the book for more details. The software can be downloaded from D-Filter’s website: 
www.d-filter.com or www.d-filter.ece.uvic.ca. In addition, a detailed Instructor’s Manual and PDF 
slides for classroom use are now being prepared, which will be made available to instructors adopting 
the book through the author’s website: www.ece.uvic.ca/~andreas. 
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INTRODUCTION TO 
DIGITAL SIGNAL 
PROCESSING 


1.1 INTRODUCTION 

The overwhelming advancements in the fabrication of microchips and their application for the design 
of efficient digital systems over the past 50 years have led to the emergence of a new discipline that 
has come to be known as digital signal processing or DSP. 

Through the use of DSP, sophisticated communication systems have evolved, the Internet 
emerged, astronomical signals can be distilled into valuable information about the cosmos, seismic 
signals can be analyzed to determine the strength of an earthquake or to predict the stability of a 
volcano, computer images or photographs can be enhanced, and so on. 

This chapter deals with the underlying principles of DSP. It begins by examining the types of 
signals that are encountered in nature, science, and engineering and introduces the sampling process 
which is the means by which analog signals can be converted to corresponding digital signals. It then 
examines the types of processing that can be applied to a signal and the types of systems that are 
available for the purpose. The chapter concludes with two introductory applications that illustrate 
the nature of DSP for the benefit of the neophyte. 

1.2 SIGNALS 

Signals arise in almost every field of science and engineering, e.g., in astronomy, acoustics, biology, 
communications, seismology, telemetry, and economics to name just a few. Signals arise naturally 
through certain physical processes or are man-made. Astronomical signals can be generated by 
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huge cosmological explosions called supernovas or by rapidly spinning neutron stars while seismic 
signals are the manifestations of earthquakes or volcanos that are about to erupt. Signals also abound in 
biology, e.g., the signals produced by the brain or heart, the acoustic signals used by dolphins or whales 
to communicate with one another, or those generated by bats to enable them to navigate or catch prey. 
Man-made signals, on the other hand, occur in technological systems, as might be expected, like 
computers, telephone and radar systems, or the Internet. Even the market place is a source of numerous 
vital signals, e.g., the prices of commodities at a stock exchange or the Dow Jones Industrial Average, 
We are very interested in natural signals for many reasons. Astronomers can extract important 
information from optical signals received from the stars, e.g., their chemical composition, they can de¬ 
cipher the nature of a supernova explosion, or determine the size of a neutron star from the periodicity 
of the signal received. Seismologists can determine the strength and center of an earthquake whereas 
volcanologists can often predict whether a volcano is about to blow its top. Cardiologists can diagnose 
various heart conditions by looking for certain telltale patterns or aberrations in electrocardiographs. 

We are very interested in man-made signals for numerous reasons: they make it possible for us 
to talk to one another over vast distances, enable the dissemination of huge amounts of information 
over the Internet, facilitate the different parts of a computer to interact with one another, instruct 
robots how to perform very intricate tasks rapidly, help aircraft to land in poor weather conditions 
and low visibility, or warn pilots about loss of separation between aircraft to avoid collisions. On the 
other hand, the market indices can help us determine whether it is the right time to invest and, if so, 
what type of investment should we go for, equities or bonds. 

In the above paragraphs, we have tacitly assumed that a signal is some quantity, property, or 
variable that depends on time, for example, the light intensity of a star or the strength of a seismic 
signal. Although this is usually the case, signals exist in which the independent parameter is some 
quantity other than time, and the number of independent variables can be more than one occasionally. 
For example, a photograph or radiograph can be viewed as a two-dimensional signal where the light 
intensity depends on the x and y coordinates which happen to be lengths. On the other hand, a 
TV image which changes with time can be viewed as a three-dimensional signal with two of the 
independent variables being lengths and one being time. 

Signals can be classified as 

• continuous-time, or 

• discrete-time. 

Continuous-time signals are defined at each and every instant of time from start to finish. For 
example, an electromagnetic wave originating from a distant galaxy or an acoustic wave produced 
by a dolphin. On the other hand, discrete-time signals are defined at discrete instants of time, perhaps 
every millisecond, second, or day. Examples of this type of signal are the closing price of a particular 
commodity at a stock exchange and the daily precipitation as functions of time. 

Nature’s signals are usually continuous in time. However, there are some important exceptions 
to the rule. For example, in the domain of quantum physics electrons gain or lose energy in discrete 
amounts and, presumably, at discrete instants. On the other hand, the DNA of all living things 
is constructed from a ladder-like structure whose ranks are made from four fundamental distinct 
organic molecules. By assigning distinct numbers to these basic molecules and treating the length of 
the ladder-like structure as if it were time, the genome of any living organism can be represented by 
a discrete-time signal. Man-made signals can be continuous- or discrete-time and typically the type 
of signal depends on whether the system that produced it is analog or digital. 
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In mathematical terms, a continuous-time signal can be represented by a function x(t) whose 
domain is a range of numbers (t\, to). where —oo < t\ and to < oo, as illustrated in Fig. 1.1a. 
Similarly, a discrete-time signal can be represented by a function x(nT), where T is the period 
between adjacent discrete signal values and n is an integer in the range (ni, n 2 ) where —00 < n\ 
and ti 2 < 00 , as shown in Fig. 1.1/?. Discrete-time signals are often generated from corresponding 
continuous-time signals through a sampling process and T is, therefore, said to be the sampling 
period. Its reciprocal, i.e., f s = 1 / 7’, is known as the sampling frequency. 

Signals can also be classified as 

• nonquantized, or 

• quantized. 

A nonquantized signal can assume any value in a specified range, whereas a quantized signal can 
assume only discrete values, usually equally spaced. Figure 1.1c and d shows quantized continuous¬ 
time and quantized discrete-time signals, respectively. 

Signals are sometimes referred to as analog or digital in the literature. By and large, an analog 
signal is deemed to be a continuous-time signal, and vice versa. Similarly, a digital signal is deemed 
to be a discrete-time signal, and vice versa. A pulse waveform, like the numerous waveforms found 
in a typical digital system, would be regarded as a digital signal if the focus were on its two-level 
idealized representation. However, if the exact actual level of the waveform were of interest, then 
the pulse waveform would be treated as a continuous-time signal as the signal level can assume an 
infinite set of values. 



Figure 1.1 Types of signals: (a) Nonquantized continuous-time signal, (b) nonquantized discrete-time 
signal, (c) quantized continuous-time signal, ( d ) quantized discrete-time signal. 
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Figure 1.2 Sampling system: (a) A/D interface, ( b ) D/A interface. 


Discrete-time signals are often generated from corresponding continuous-time signals through 
the use of an analog-to-digital (A/D) interface and, similarly, continuous-time signals can be obtained 
by using a digital-to-analog (D/A) interface. An A/D interface typically comprises three components, 
namely, a sampler, a quantizer, and an encoder as depicted in Fig. 1.2a. In the case where the signal 
is in the form of a continuous-time voltage or current waveform, the sampler in its bare essentials 
is a switch controlled by a clock signal, which closes momentarily every T s thereby transmitting 
the level of the input signal x(t ) at instant nT, that is, x(nT), to the output. A quantizer is an analog 
device that will sense the level of its input and produce as output the nearest available level, say, 
x q (n T ), from a set of allowed levels, i.e., a quantizer will produce a quantized continuous-time signal 
such as that shown in Fig. 1.1c. An encoder is essentially a digital device that will sense the voltage 
or current level of its input and produce a corresponding number at the output, i.e., it will convert 
a quantized continuous-time signal of the type shown in Fig. 1.1c to a corresponding discrete-time 
signal of the type shown in Fig. 1.1 d. 

The D/A interface comprises two modules, a decoder and a smoothing device as depicted in 
Fig. 1.2 b. The decoder will convert a discrete-time signal into a corresponding quantized voltage 
waveform such as that shown in Fig. 1.1c. The purpose of the smoothing device is to smooth out the 
quantized waveform and thus eliminate the inherent discontinuities. 

The A/D and D/A interfaces are readily available as off-the-shelf components known as A/D 
and D/A converters and many types, such as high-speed, low-cost, and high-precision, are available. 


1.3 FREQUENCY-DOMAIN REPRESENTATION 

Signals have so far been represented in terms of functions of time, i.e., x(t) or x(nT). In many 
situations, it is useful to represent signals in terms of functions of frequency. For example, a 
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Table 1.1 Parameters of signal in Eq. (1.1) 


k 

UJ k 

A* 

0* 

1 

1 

0.6154 

0.0579 

2 

2 

0.7919 

0.3529 

3 

3 

0.9218 

-0.8132 

4 

4 

0.7382 

0.0099 

5 

5 

0.1763 

0.1389 

6 

6 

0.4057 

-0.2028 

7 

7 

0.9355 

0.1987 

8 

8 

0.9169 

-0.6038 

9 

9 

0.4103 

-0.2722 


continuous-time signal made up of a sum of sinusoidal components such as 

9 

x(t) = ^A k sin (co k t + 4> k ) (1.1) 

k=i 


can be fully described by two sets, 1 say, 


A(a>) = {A*: co — a>k for k = 1, 2, ..., 9} 


and 


< p(co ) = {<pk~- oj = 00k for k = 1, 2, ..., 9} 

that describe the amplitudes and phase angles of the sinusoidal components present in the signal. 
Sets A{co) and cf>(oo) can be referred to as the amplitude spectrum and phase spectrum of the signal, 
respectively, for obvious reasons, and can be represented by tables or graphs that give the amplitude 
and phase angle associated with each frequency. For example, if A;, and <pk in Eq. (1.1) assume the 
numerical values given by Table 1.1, then x(t) can be represented in the time domain by the graph 
in Fig. 1.3a and in the frequency domain by Table 1.1 or by the graphs in Fig. 1.3£> and c. 

The usefulness of a frequency-domain or simply spectral representation can be well appre¬ 
ciated by comparing the time- and frequency-domain representations in Fig. 1.3. The time-domain 
representation shows that what we have is a noise-like periodic signal. Its periodicity is to be expected 
as the signal is made up of a sum of sinusoidal components that are periodic. The frequency-domain 
representation, on the other hand, provides a fairly detailed and meaningful description of the indi¬ 
vidual frequency components, namely, their frequencies, amplitudes, and phase angles. 


l This representation of a set will be adopted throughout the book. 
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Figure 1.3 Time- and frequency-domain representations of the periodic signal represented by Eq. (1.1) 
with the parameters given in Table 1.1: (a) Time-domain representation, ( b ) amplitude spectrum, (c) phase 
spectrum. 


The representation in Eq. (1.1) is actually the Fourier series of signal x(t) and deriving the 
Fourier series of a periodic signal is just one way of obtaining a spectral representation for a signal. 
Scientists, mathematicians, and engineers have devised a variety of mathematical tools that can be 
used for the spectral representation of different types of signals. Other mathematical tools, in addition 
to the Fourier series, are the Fourier transform which is applicable to periodic as well as nonperiodic 
continuous-time signals; the z transform which is the tool of choice for discrete-time nonperiodic 
signals; and the discrete-Fourier transform which is most suitable for discrete-time periodic signals. 
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The Fourier series and Fourier transform will be reviewed in Chap. 2, the z transform will be examined 
in detail in Chap. 3, and the discrete-Fourier transform will be treated in Chap. 7. 

1.4 NOTATION 

The notation introduced in Sec. 1.2 for the representation of discrete-time signals, i.e., x(nT), 
preserves the exact relation between a discrete-time signal and the underlying continuous-time signal 
x(t) for the case where the former is generated from the latter through the sampling process. The 
use of this notation tends to be somewhat cumbersome on account of the numerous 7s that have to 
be repeated from one equation to the next. For the sake of simplicity, many authors use x(n) or x„ 
instead of x(nT). These simplified notations solve one problem but create another. For example, a 
discrete-time signal generated from the continuous-time signal 

x(t) — e at sin(&>f) 

through the sampling process would naturally be 

x{nT) = e anT sin (wnT) 

If we were to drop the T in x(n T ), that is, 

x(n) — e anT sin (conT) 

then a notation inconsistency is introduced as evaluating x(t) at t — n does not give the correct 
expression for the discrete-time signal. This problem tends to propagate into the frequency domain 
and, in fact, it causes the spectral representation of the discrete-time signal to be inconsistent with 
that of the underlying continuous-time signal. 

The complex notation can be avoided while retaining consistency between the continuous- 
and discrete-time signals through the use of time normalization. In this process, the time axis of the 
continuous-time signal is scaled by replacing t by t/T in x(t), that is, 



If t is now replaced by nT. we get 


In the above time normalization, the sampling period is, in effect, changed from T to 1 s and, 
consequently, T disappears from the picture. Time normalization can be reversed by applying time 
denormalization by simply replacing n by n T where T is the actual sampling period. 

In this book, the full notation x(nT ) will be used when dealing with the fundamentals, namely, 
in Chaps. 3-6. In later chapters, signals will usually be assumed to be normalized with respect to 
time and, in such cases, the simplified notation x(n) will be used. The notation x„ will not be used. 

It was mentioned earlier that the independent variable can be some quantity other than time, 
e.g., length. Nevertheless, the symbol T will be used for these situations as well, for the sake of 
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a consistent notation. In certain situations, the entity to be processed may well be just a sequence 
of numbers that are independent of any physical quantity. In such situations, x(n) is the correct 
notation. The theories presented in this book apply equally well to such entities but the notions of 
time domain and frequency domain lose their usual physical significance. We are, in effect, dealing 
with mathematical transformations. 

1.5 SIGNAL PROCESSING 

Signal processing is the science of analyzing, synthesizing, sampling, encoding, transforming, de¬ 
coding, enhancing, transporting, archiving, and in general manipulating signals in some way. With 
the rapid advances in very-large-scale integrated (VLSI) circuit technology and computer systems, 
the subject of signal processing has mushroomed into a multifaceted discipline with each facet de¬ 
serving its own volume. This book is concerned primarily with the branch of signal processing that 
entails the spectral characteristics and properties of signals. 

The spectral representation and analysis of signals in general are carried out through the 
mathematical transforms alluded to in the previous section, e.g., the Fourier series and Fourier 
transform. If the processing entails modifying, reshaping, or transforming the spectrum of a signal 
in some way, then the processing involved will be referred to as filtering in this book. 

Filtering can be used to select one or more desirable and simultaneously reject one or more 
undesirable bands of frequency components, or simply frequencies. For example, one could use 
lowpass filtering to select a band of preferred low frequencies and reject a band of undesirable high 
frequencies from the frequencies present in the signal depicted in Fig. 1.3, as illustrated in Fig. 1.4; 
use highpass filtering to select a band of preferred high frequencies and reject a band of undesirable 
low frequencies as illustrated in Fig. 1.5; use bandpass filtering to select a band of frequencies and 
reject low and high frequencies as illustrated in Fig. 1.6; or use bandstop filtering to reject a band of 
frequencies but select low frequencies and high frequencies as illustrated in Fig. 1.7. 

In the above types of filtering, one or more undesirable bands of frequencies are rejected or 
filtered out and the term filtering is quite appropriate. In some other types of filtering, certain frequency 
components are strengthened while others are weakened, i.e., nothing is rejected or filtered out. Yet 
these processes transform the spectrum of the signal being processed and, as such, they fall under the 
category of filtering in the broader definition of filtering adopted in this book. Take differentiation, 
for example. Differentiating the signal in Eq. (1.1) with respect to t gives 

9 d 9 

y. — [A* sin (co k t + 4> k )] = co k A k cos (co k t + (p k ) 

k= 1 a k= I 

9 

y, co k A k sin (co k t + (p k + \n ) 
k= 1 

The amplitude and phase spectrums of the signal have now become 


dx(t ) 
dt 


A(co) = { a> k A k : to = co k for k = 1, 2, ..., 9} 


and 


<p(to) = {(p k + f.to — co k for k — 1, 2, ..., 9} 
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Figure 1.4 Lowpass filtering applied to the signal depicted in Fig. 1.3: («) Time-domain representation, 
( b) amplitude spectrum, (c) phase spectrum. 


respectively. The effect of differentiating the signal of Eq. (1.1) is illustrated in Fig. 1.8. As can be 
seen by comparing Fig. 1.3 b and c with Fig. 1.8/; and c, differentiation scales the amplitudes of 
the different frequency components by a factor that is proportional to frequency and adds a phase 
angle of \n to each value of the phase spectrum. In other words, the amplitudes of low-frequency 
components are attenuated, whereas those of high-frequency components are enhanced. In effect, 
the process of differentiation is a type of highpass filtering. 
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Figure 1.5 Highpass filtering applied to the signal depicted in Fig. 1 .3: ( a ) Time-domain representation, 
(b) amplitude spectrum, (c) phase spectrum. 


Integrating x{t ) with respect to time, on the other hand, gives 

„ 9 9 r 


x(t)dt = ^ / A k sin^t + (j) k )dt = ^ 


k= 1 
9 


k=\ 


Ak 

-cos {w k t + 4>k ) 

(Ok 


= V' — Sin (co k t + (p k - j7r) 

t! Wk 
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Figure 1.6 Bandpass filtering applied to the signal depicted in Fig. 1.3: (a) Time-domain representation, 
(. b ) amplitude spectrum, (c) phase spectrum. 


In this case, the amplitude and phase spectrums become 


A(a>) = [Ak/a>k : a> = a>k for k = 1, 2, ..., 9} 


and 


t p(a >) = {(pk — :co — co^ for k — 1, 2, ..., 9} 
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Figure 1.7 Bandstop filtering applied to the signal depicted in Fig. 1.3: (a) Time-domain representation, 
(b) amplitude spectrum, (c) phase spectrum. 


respectively, i.e., the amplitudes of the different frequency components are now scaled by a factor that 
is inversely proportional to the frequency and a phase angle of jjr is subtracted from each value of 
the phase spectrum. Thus, integration tends to enhance low-frequency and attenuate high-frequency 
components and, in a way, it tends to behave very much like lowpass filtering as illustrated in Fig. 1.9. 

In its most general form, filtering is a process that will transform the spectrum of a signal 
according to some rule of correspondence. In the case of lowpass filtering, the rule of correspondence 
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Figure 1.8 Differentiation applied to the signal depicted in Fig. 1.3: (a) Time-domain representation, 
(b) amplitude spectrum, (c) phase spectrum. 


might specify, for example, that the spectrum of the output signal be approximately the same as that of 
the input signal for some low-frequency range and approximately zero for some high-frequency range. 

Electrical engineers have known about filtering processes for well over 80 years and, through 
the years, they invented many types of circuits and systems that can perform filtering, which are 
known collectively as filters. Filters can be designed to perform a great variety of filtering tasks, in 
addition, to those illustrated in Figs. 1.4-1.9. For example, one could easily design a lowpass filter 
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Figure 1.9 Integration applied to the signal depicted in Fig. 1.3: (a) Time-domain representation, 
(b) amplitude spectrum, (c) phase spectrum. 


that would select low frequencies in the range from 0 to co p and reject high frequencies in the range 
from a) a to oo. In such a filter, the frequency ranges from 0 to co p and u> a to oo, are referred to as the 
passband and stopband, respectively. 

Filters can be classified on the basis of their operating signals as analog or digital. In analog 
filters, the input, output, and internal signals are in the form of continuous-time signals, whereas in 
digital filters they are in the form of discrete-time signals. 
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1.6 ANALOG FILTERS 

This book is concerned mainly with DSP and with discrete-time systems that can perform DSP, such 
as digital filters. Since digital filters evolved as a natural extension of analog filters and are often 
designed through the use of analog-filter methodologies, a brief outline of the historical evolution 
and applications of analog filters are worthwhile. 

Analog filters were originally invented for use in radio receivers and long-distance telephone 
systems and continue to be critical components in all types of communication systems. Various 
families of analog filters have evolved over the years, which can be classified as follows on the basis 
of their constituent elements and the technology used [1, 2], 2 

• Passive RLC 3 filters 

• Discrete active RC filters 

• Integrated active R C filters 

• Switched-capacitor filters 

• Microwave filters 

Passive RLC filters began to be used extensively in the early twenties. They are made of 
interconnected resistors, inductors, and capacitors and are said to be passive in view of the fact that 
they do not require an energy source, like a power supply, to operate. Filtering action is achieved 
through the property of electrical resonance which occurs when an inductor and a capacitor are 
connected in series or in parallel. The importance of filtering in communications motivated engineers 
and mathematicians between the thirties and fifties to develop some very powerful and sophisticated 
methods for the design of passive RLC filters. 

Discrete active RC filters began to appear during the mid-fifties and were a hot topic of 
research during the sixties. They comprise discrete resistors, capacitors, and amplifying electronic 
circuits. Inductors are absent and it is this feature that makes active RC filters attractive. Inductors 
have always been bulky, expensive, and generally less ideal than resistors and capacitors particularly 
for low-frequency applications. Unfortunately, without inductors, electrical resonance cannot be 
achieved and with just resistors and capacitors only crude types of filters can be designed. However, 
through the clever use of amplifying electronic circuits in RC circuits, it is possible to simulate 
resonance-like effects that can be utilized to achieve filtering of high quality. These filters are said to 
be active because the amplifying electronic circuits require an energy source in the form of a power 
supply. 

Integrated-circuit active RC filters operate on the basis of the same principles as their discrete 
counterparts except that they are designed directly as complete integrated circuits. Through the use 
of high-frequency amplifying circuits and suitable integrated-circuit elements, filters that can operate 
at frequencies as high as 15 GHz can be designed [3, 4]. 4 Interest in these filters has been strong 
during the eighties and nineties and research continues. 

Switched-capacitor filters evolved during the seventies and eighties. These are essentially 
active RC filters except that switches are also utilized along with amplifying devices. In this family 


2 Numbered references will be found at the end of each chapter. 

3 R. L. and C are the symbols used for the electrical properties of resistance, inductance, and capacitance, respectively. 

4 One GHz equals 10 9 Hz. 
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of filters, switches are used to simulate high resistance values which are difficult to implement in 
integrated-circuit form. Like integrated active RC filters, switched-capacitors filters are compatible 
with integrated-circuit technology. 

Microwave filters are built from a variety of microwave components and devices such as 
transverse electromagnetic (TEM) transmission lines, waveguides, dielectric resonators, and surface 
acoustic devices [5]. They are used in applications where the operating frequencies are in the range 
0.5 to 500 GHz. 

1.7 APPLICATIONS OF ANALOG FILTERS 

Analog filters have found widespread applications over the years. A short but not exhaustive list is 
as follows: 

• Radios and TVs 

• Communication and radar systems 

• Telephone systems 

• Sampling systems 

• Audio equipment 

Every time we want to listen to the radio or watch TV, we must first select our favorite radio 
station or TV channel. What we are actually doing when we turn the knob on the radio or press the 
channel button on the remote control is tuning the radio or TV receiver to the broadcasting frequency 
of the radio station or TV channel, and this is accomplished by aligning the frequency of a bandpass 
filter inside the receiver with the broadcasting frequency of the radio station or TV channel. 

When we tune a radio receiver, we select the frequency of a desirable signal, namely, that of 
our favorite radio station. The signals from all the other stations are undesirable and are rejected. 
The same principle can be used to prevent a radar signal from interfering with the communication 
signals at an airport, for example, or to prevent the communication signals from interfering with the 
radar signals. 

Signals are often corrupted by spurious signals known collectively as noise. Such signals may 
originate from a large number of sources, e.g., lightnings, electrical motors, transformers, and power 
lines. Noise signals are characterized by frequency spectrums that stretch over a wide range of 
frequencies. They can be eliminated through the use of bandpass filters that would pass the desired 
signal but reject everything else, namely, the noise content, as in the case of a radio receiver. 

We all talk daily to our friends and relatives through the telephone system. More often than 
not, they live in another city or country and the conversation must be carried out through expensive 
communication channels. If these channels were to carry just a single voice, as in the days of 
Alexander Graham Bell, 5 no one would ever be able to afford a telephone call to anyone, even 
the very rich. What makes long-distance calls affordable is our ability to transmit thousands of 
conversations through one and the same communications channel. And this is achieved through the 
use of a so-called frequency-division multiplex (FDM) communications system [6]. A rudimentary 


5 (1847—1921) Scottish-born scientist and inventor who spent most of his career in the northeast US and Canada. He 
invented the telephone between 1874 and 1876. 
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Figure 1.10 Frequency-division multiplex communications system: (a) Basic system, ( b ) frequency 
spectrum of g(t). 


version of this type of system is illustrated in Fig. 1.10«. The operation of an FDM communications 
system is as follows: 

1. At the transmit end, the different voice signals are superimposed on different carrier frequencies 
using a process known as modulation. 

2. The different carrier frequencies are combined by using an adder circuit. 

3. At the receive end, carrier frequencies are separated using bandpass filters. 

4. The voice signals are then extracted from the carrier frequencies through demodulation. 

5. The voice signals are distributed to the appropriate persons through the local telephone wires. 
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What the transmit section does in the above system is to add the frequency of a unique carrier to 
the frequencies of each voice signal, thereby shifting its frequency spectrum by the frequency of the 
carrier. In this way, the frequency spectrums of the different voice signals are arranged contiguously 
one after the other to form the composite signal git ) which is referred to as a group by telephone 
engineers. The frequency spectrum of g(t) is illustrated in Fig. 1.10/?. The receive section, on the 
other hand, separates the translated voice signals and restores their original spectrums. 

As can be seen in Fig. 1.10a, the above system requires as many bandpass filters as there are 
voice signals. On top of that, there are as many modulators and demodulators in the system and these 
devices, in their turn, need a certain amount of filtering to achieve their proper operation. In short, 
communications systems are simply not feasible without filters. 

Incidentally, several groups can be further modulated individually and added to form a super¬ 
group as illustrated in Fig. 1.11 to increase the number of voice signals transmitted over an intercity 
cable or microwave link, for example. At the receiving end, a supergroup is subdivided into the 
individual groups by a bank of bandpass filters which are then, in turn, subdivided into the individual 
voice signals by appropriate banks of bandpass filters. Similarly, several supergroups can be com¬ 
bined into a master group, and so on, until the bandwidth capacity of the cable or microwave link is 
completely filled. 

An important principle to be followed when designing a sampling system like the one illus¬ 
trated in Fig. 1.2 is that the sampling frequency be at least twice the highest frequency present in 
the spectrum of the signal by virtue of the sampling theorem (see Chap. 6). In situations where 
the sampling frequency is fixed and the highest frequency present in the signal can exceed half 
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Frequency-division multiplex communications system with two levels of modulation. 
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the sampling frequency, it is crucial to bandlimit the signal to be sampled to prevent a certain type of 
signal distortion known as aliasing. This bandlimiting process, which amounts to removing signal 
components whose frequencies exceed half the sampling frequency, can be carried out through the 
use of a lowpass filter. 

Discrete-time signals are often converted back to continuous-time signals. For example, the 
signal recorded on a compact disk (CD) is actually a discrete-time signal. The function of a CD 
player is to reverse the sampling process illustrated in Fig. 1.2, that is, it must read the discrete-time 
signal, decode it, and reproduce the original continuous-time audio signal. As will be shown later on 
in Chap. 6, the continuous-time signal can be reconstructed through the use of a lowpass filter. 

Loudspeaker systems behave very much like filters and, consequently, they tend to change 
the spectrum of an audio signal. This is due to the fact that the enclosure or cabinet used can often 
exhibit mechanical resonances that are superimposed on the audio signal. In fact, this is one of the 
reasons why different makes of loudspeaker systems often produce their own distinct sound which, 
in actual fact, is different from the sound recorded on the CD. To compensate for such imperfections, 
sound reproduction equipment, such as CD players and stereos, are often equipped with equalizers 
that can be used to reshape the spectrum of the audio signal. These subsystems typically incorporate 
a number of sliders that can be adjusted to modify the quality of the sound reproduced. One can, for 
example, strengthen or weaken the low-frequency or high-frequency content (bass or treble) of the 
audio signal. Since an equalizer is a device that can modify the spectrum of a signal, equalizers are 
filters in the broader definition adopted earlier. What the sliders do is to alter the parameters of the 
filter that performs the equalization. In the same way, one can also compensate for the acoustics of 
the room. For example, one might need to boost the treble a bit if there is a thick carpet in the room 
because the carpet could absorb a large amount of the high-frequency content. 

Transmission lines, telephone wires, and communication channels often behave very much 
like filters and, as a result, they tend to reshape the spectrums of the signals transmitted through 
them. The local telephone lines are particularly notorious in this respect. We often do not recognize 
the voice of the person at the other end only because the spectrum of the signal has been significantly 
altered. As in loudspeaker systems, the quality of transmission through communication channels 
can be improved by using suitable equalizers. In fact, it is through the use of equalizers that it is 
possible to achieve high data transmission rates through local telephone lines. This is achieved by 
incorporating sophisticated equalizers in the modems at either end of a telephone line. 


1.8 DIGITAL FILTERS 

In its most general form, a digital filter is a system that will receive an input in the form of a 
discrete-time signal and produce an output again in the form of a discrete-time signal, as illustrated 
in Fig. 1.12. There are many types of discrete-time systems that fall under this category such as 
digital control systems, encoders, and decoders. What differentiates digital biters from other digital 
systems is the nature of the processing involved. As in analog biters, there is a requirement that the 
spectrum of the output signal be related to that of the input by some rule of correspondence. 

The roots of digital biters go back in history to the 1600s when mathematicians, on the one hand, 
were attempting to deduce formulas for the areas of different geometrical shapes, and astronomers, 
on the other, were attempting to rationalize and interpret their measurements of planetary orbits. 
A need arose in those days for a process that could be used to interpolate a function represented 
by numerical data, and a wide range of numerical interpolation formulas were proposed over the 
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Figure 1.12 The digital filter as a discrete-time system. 


years by Gregory (1638-1675), Newton (1642-1727), Taylor (1685-1731), Stirling (1692-1770), 
Lagrange (1736-1813), Bessel (1784-1846), and others [7, 8]. On the basis of interpolation formulas, 
formulas that will perform numerical differentiation or integration on a function represented by 
numerical data can be generated. These formulas were put to good use during the seventeenth and 
eighteenth centuries in the construction of mathematical, scientific, nautical, astronomical, and a host 
of other types of numerical tables. In fact, it was the great need for accurate numerical tables that 
prompted Charles Babbage (1791-1871) to embark on his lifelong quest to automate the computation 
process through his famous difference and analytical engines [9], and it is on the basis of numerical 
formulas that his machines were supposed to perform their computations. 

Consider the situation where a numerical algorithm is used to compute the derivative of a 
signal x{t) at t = t\ , to, ..., tx, and assume that the signal is represented by its numerical values 
x(t\), x(t 2 ), ..., x(t M ). In such a situation, the algorithm receives a discrete-time signal as input 
and produces a discrete-time signal as output, which is a differentiated version of the input signal. 
Since differentiation is essentially a filtering process, as was demonstrated earlier on, an algorithm 
that performs numerical differentiation is, in fact, a digital filtering process. 

Numerical methods have found their perfect niche in the modern digital computer and consid¬ 
erable progress has been achieved through the fifties and sixties in the development of algorithms 
that can be used to process signals represented in terms of numerical data. By the late fifties, a cohe¬ 
sive collection of techniques referred to as data smoothing and prediction began to emerge through 
the efforts of pioneers such as Blackman, Bode, Shannon, Tukey [10, 11], and others. During the 
early sixties, an entity referred to as the digital filter began to appear in the literature to describe 
a collection of algorithms that could be used for spectral analysis and data processing [12-17]. In 
1965, Blackman described the state of the art in the area of data smoothing and prediction in his 
seminal book on the subject [18], and included in this work certain techniques which he referred to 
as numerical filtering. Within a year, in 1966, Kaiser authored a landmark chapter, entitled “Digital 
Filters” [19] in which he presented a collection of signal processing techniques that could be applied 
for the simulation of dynamic systems and analog filters. From the late sixties on, the analysis and 
processing of signals in the form of numerical data became known as digital signal processing , and 
algorithms, computer programs, or systems that could be used for the processing of these signals 
became fully established as digital filters [20-22]. 
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With the rapid advances in integrated-circuit technology during the sixties, a trend toward 
digital technologies began to emerge to take advantage of the classical merits of digital systems in 
general, which are as follows: 

• Component tolerances are uncritical. 

• Accuracy is high. 

• Physical size is small. 

• Reliability is high. 

• Component drift is relatively unimportant. 

• The influence of electrical environmental noise is negligible. 

Owing to these important features, digital technologies can be used to design cost-effective, reliable, 
and versatile systems. Consequently, an uninterrupted evolution, or more appropriately revolution, 
began to take place from the early sixties on whereby analog systems were continuously being 
replaced by corresponding digital systems. First, the telephone system was digitized through the 
use of pulse-code modulation, then came long-distance digital communications, and then the music 
industry adopted digital methodologies through the use of compact disks and digital audio tapes. 
And more recently, digital radio and high-definition digital TV began to be commercialized. Even 
the movie industry has already embarked on large-scale digitization of the production of movies. 

Digital filters in hardware form began to appear during the late sixties and two early designs 
were reported by Jackson, Kaiser, and McDonald in 1968 [23] and Peled and Liu in 1974 [24]. 

Research on digital filters continued through the years and a great variety of filter types have 
evolved, as follows: 

• Nonrecursive filters 

• Recursive filters 

• Fan filters 

• Two-dimensional filters 

• Adaptive filters 

• Multidimensional filters 

• Multirate filters 

The applications of digital filters are widespread and include but are not limited to the following: 

• Communications systems 

• Audio systems such as CD players 

• Instrumentation 

• Image processing and enhancement 

• Processing of seismic and other geophysical signals 

• Processing of biological signals 

• Artificial cochleas 

• Speech synthesis 
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It is nowadays convenient to consider computer programs and digital hardware that can perform 
digital filtering as two different implementations of digital filters, namely, 

• software 

• hardware. 

Software digital filters can be implemented in terms of a high-level language, such as C++ or 
MATLAB, on a personal computer or workstation or by using a low-level language on a general- 
purpose digital signal-processing chip. At the other extreme, hardware digital filters can be designed 
using a number of highly specialized interconnected VLSI chips. Both hardware and software digital 
filters can be used to process real-time or nonreal-time (recorded) signals, except that the former are 
usually much faster and can deal with real-time signals whose frequency spectrums extend to much 
higher frequencies. Occasionally, digital filters are used in so-called quasi-real-time applications 
whereby the processing appears to a person to be in real time although, in actual fact, the samples 
of the signal are first collected and stored in a digital memory and are then retrieved in blocks and 
processed. A familiar, quasi-real-time application involves the transmission of radio signals over 
the Internet. These signals are transmitted through data packets in a rather irregular manner. Yet 
the music appears to be continuous only because the data packets are first stored and then properly 
sequenced. This is why it takes a little while for the transmission to begin. 

Hardware digital filters have an important advantage relative to analog filters, in addition to 
the classical merits associated with digital systems in general. The parameters of a digital filter are 
stored in a computer memory and, consequently, they can be easily changed in real time. This means 
that digital filters are more suitable for applications where programmable, time-variable, or adaptive 
filters are required. However, they also have certain important limitations. At any instant, say, t — n T, 
a digital filter generates the value of the output signal through a series of computations using some of 
the values of the input signal and possibly some of the values of the output signal (see Chap. 4). Once 
the sampling frequency, f s , is fixed, the sampling period T — l/f s is also fixed and, consequently, 
a basic limitation is imposed by the amount of computation that can be performed by the digital 
filter during period T. Thus as the sampling frequency is increased, T is reduced, and the amount of 
computation that can be performed during period T is reduced. Eventually, at some sufficiently high 
sampling frequency, a digital filter will become computation bound and will malfunction. In effect, 
digital filters are suitable for low-frequency applications where the operating frequencies are in some 
range, say, 0 to co max . The upper frequency of applicability, co max , is difficult to formalize because it 
depends on several factors such as the number-crunching capability and speed of the digital hardware 
on the one hand and the complexity of the filtering tasks involved on the other. 

Another basic limitation of digital filters comes into play in situations where the signal is in 
continuous-time form and a processed version of the signal is required, again in continuous-time 
form. In such a case, the signal must be converted into a discrete-time form, processed by the digital 
filter, and then converted back to a continuous-time form. The two conversions involved would 
necessitate various interfacing devices, e.g., A/D and D/A converters, and a digital-filter solution 
could become prohibitive relative to an analog-filter solution. This limitation is, of course, absent if 
we are dealing with a digital system to start with in which the signals to be processed are already in 
discrete-time form. 

Table 1.2 summarizes the frequency range of applicability for the various types of filters [1]. 
As can be seen, for frequencies less than, say, 20 kHz digital filters are most likely to offer the best 
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Table 1.2 Comparison of filter technologies 


Type of technology 

Frequency range 

Digital filters 

0 tO ftj max 

Discrete active RC filters 

10 Hz to 1 MHz 

Switched-capacitor filters 

10 Hz to 5 MHz 

Passive RLC filters 

0.1 MHz to 0.1 GHz 

Integrated active RC filters 

0.1 MHz to 15 GHz 

Microwave filters 

0.5 GHz to 500 GHz 


engineering solution whereas for frequencies in excess of 0.5 GHz, a microwave filter is the obvious 
choice. For frequencies between 20 kHz and 0.5 GHz, the choice of filter technology depends on 
many factors and trade-offs and is also critically dependent on the type of application. 

To conclude this section, it should be mentioned that software digital filters have no counterpart 
in the analog world and, therefore, for nonreal-time applications, they are the only choice. 


1.9 TWO DSP APPLICATIONS 

in this section, we examine two typical applications of filtering, namely, its use for the processing of 
an electrocardiogram (EKG), on the one hand, and the processing of stock exchange data, on the other. 

1.9.1 Processing of EKG Signals 

The EKG of a healthy individual assumes a fairly well-defined form although significant variations 
can occur from one person to the next as in fingerprints. Yet certain telltale patterns of an EKG 
enable a cardiologist to diagnose certain cardiac ailments or conditions. An EKG is essentially 
a graph representing a low-level electrical signal picked up by a pair of electrodes attached to 
certain well-defined points on the body and connected to an electrical instrument known as the 
electrocardiograph. These machines are used in clinics and hospitals where a multitude of other 
types of electrical machines are utilized such as x-ray machines and electrical motors. All these 
machines along with the power lines and transformers that supply them with electricity produce 
electrical 60-Hz noise, which may contaminate an EKG waveform. A typical noise-free EKG signal 
is shown in Fig. 1.13a. An EKG signal that has been contaminated by electrical 60-Hz noise is 
illustrated in Fig. 1.13&. As can be seen, the distinct features of the EKG are all but obliterated in 
the contaminated signal and are, therefore, difficult, if not impossible, to discern. A diagnosis based 
on such an EKG would be unreliable. 

As electrical noise originating from the power supply has a well-defined frequency, i.e., 60 Hz, 
one can design a bandstop filter that will reject the electrical noise. Such a filter has been designed 
using the methods to be studied in later chapters and was then applied to the contaminated EKG 
signal. The filtered signal is shown in Fig. 1.13c and, as can be seen, apart from some transient 
artifacts over the interval n — 0 to 100, the filtered signal is a faithful reproduction of the original 
noise-free signal. As another experiment, just to illustrate the nature of filtering, the contaminated 




24 DIGITAL SIGNAL PROCESSING 



Sample index n 
(a) 


Sample index n 
( b) 





(c) 


400 600 800 

Sample index n 
(d) 


Figure 1.13 Processing of EKG waveform: (a) Typical EKG, ( b ) noisy EKG, (c) noisy EKG processed 
with a bandstop filter, (d) noisy EKG waveform processed with a bandpass filter. 


EKG signal was passed through a bandpass filter which was designed to select the 60-Hz noise 
component. The output of the bandpass filter is illustrated in Fig. 1.13d. After an initial transience 
over the interval n = 0 to 150, a steady noise component is isolated by the bandpass filter. This is 
actually a sinusoidal waveform. It does not appear to be so because there are only six samples per 
cycle with the approximate values of 0, 1.7, 1.7, 0, —1.7, and —1.7. 

1.9.2 Processing of Stock-Exchange Data 

We are all interested in the health of the market place for various reasons. We would all like, for 
example, to put aside some funds for another day and, naturally, we would prefer to invest any such 
funds in secure low-risk stocks, bonds, or mutual funds that provide high returns. To make financial 
decisions such as these, we read the business section of our daily newspaper or browse the Web for 
numerical stock-exchange data. Naturally, we would like to make investments that grow steadily 
from year to year at a steady rate and never devalue. However, this is not what happens in real life. 
The prices of stocks change rapidly with time and once in a while, for example, when a market 
recession occurs, they can actually lose a large proportion of their values. 

Typically, there are many economic forces that cause the value of a stock to change. Some of 
these forces are of short duration while others reflect long-term economic pressures. As long-term 
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investors, we should perhaps ignore the day-to-day variations and focus as far as possible on the 
underlying changes in the stock price. An investor with a sharp eye may be able to draw conclusions 
by simply comparing the available stock-exchange data of two competing stocks. For most of us this 
is not an easy task. However, through the use of DSP the task can be greatly simplified, as will be 
demonstrated next. 

The price of a company’s stock is a signal and, as such, it possesses a spectrum that can be 
manipulated through filtering. Day-to-day variations in a stock constitute the high-frequency part of 
the spectrum whereas the underlying trend of the stock is actually the low-frequency part. If we are 
interested in the long-term behavior of a stock, then perhaps we should filter out the high-frequency 
part of the spectrum. On the other hand, if we cannot tolerate large day-to-day variations, then, 
perhaps we should attempt to check the volatility of the stock. Measures of volatility are readily 
available, for example, the variance of a stock. Another way to ascertain the volatility would be to 
remove the low-frequency and retain the high-frequency content of a stock through a highpass filter. 

To illustrate these ideas, two actual mutual funds, a bond fund and a high-tech fund, were chosen 
at random for processing. One year’s worth of data were chosen for processing and to facilitate the 
comparison, the scaled share prices of the two funds were normalized to unity at the start of the year. 
The normalized share prices of the two funds are plotted in Fig. 1.14 a. As can be seen, the bond 
fund has remained rather stable throughout the year, as may be expected, whereas the high-tech one 
was subjected to large variations. The day-to-day variations, i.e., the high-frequency content, in the 
two mutual funds can be eliminated through the use of a lowpass filter to obtain the smooth curves 
shown in Fig. 1.14b. On the other hand, the underlying trend of the mutual fund or the low-frequency 
spectrum can be removed through the use of a highpass filter to obtain the high-frequency content 
shown in Fig. 1.14c. In this figure, the filter output is depicted as a percentage of the unit value. 

In the plots obtained, certain anomalies are observed during the first 50 or so sample values. 
These are due to certain initial transient conditions that exist in all types of systems including 
filters, which will be explained in Chap. 4, but they can be avoided in practice by using a suitable 
initialization. Ignoring this initial phase, we note that the lowpass-filtered version of the data shown 
in Fig. 1.14b provides a less cluttered view of the funds whereas Fig. 1.14c gives a much clearer 
picture of their relative volatilities. In this respect, note the 5 to 1 difference in the scale of the y axis 
between the two funds. 

Quantitative measures of volatility analogous to the variance of a stock can also be deduced 
from plots like those in Fig. 1.14c. One could, for example, obtain the mean-square average (MSA) 
of y(n) which is defined as 


MSA= ^J2[y(n)] 2 

n= 1 


or the average of \y(n)\ or some other norm. The value of the MSA for the bond and high-tech funds 
for values of 50 < n < 250 can be readily computed as 0.0214 and 1.2367, respectively, i.e., a ratio 
of 1 to 57.7 in favor of the bond fund. Evidently, the message is very clear as to what type of fund 
one should buy to avoid sleepless nights. 

Another intriguing possibility that deserves a mention is the use of extrapolating filters. Filters 
of this type can be used to predict tomorrow’s stock prices but if we pursue the subject any further, 
we will find ourselves in the domain of what is known in the business world as technical analysis. 
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Figure 1.14 Processing of stock-exchange data: (a) Unit values of bond and high technology mutual funds, 
( b ) data processed with a lowpass filter. 
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CHAPTER 

2 


THE FOURIER 
SERIES 
AND FOURIER 
TRANSFORM 


2.1 INTRODUCTION 

Spectral analysis has been introduced in a heuristic way in Chap. 1. In the present chapter, the spectral 
analysis of continuous-time signals is developed further. The basic mathematical tools required 
for the job, namely, the Fourier series and the Fourier transform, are described in some detail. 
The Fourier series, which provides spectral representations for periodic continuous-time signals, 
is treated first. Then the Fourier transform is derived by applying a limiting process to the Fourier 
series. The properties of the Fourier series and the Fourier transform are delineated through a number 
of theorems. The chapter also deals with the application of the Fourier series and Fourier transform 
to a variety of standard continuous-time signals. 

The reader may question the extent of the treatment of the spectral representation of continuous¬ 
time signals in a book that claims to deal with DSP. However, as was emphasized in Chap. 1, most 
of the signals occurring in nature are essentially continuous in time, and it is, therefore, reasonable 
to expect the spectrums of discrete-time signals to be closely related to those of the continuous-time 
signals from which they are derived. This indeed is the case, as will be shown in Chaps. 3, 6, and 7. 

2.2 FOURIER SERIES 

In Chap. 1, the concept of frequency spectrum of a signal was introduced as an alternative to time- 
domain representation. As was demonstrated, a periodic signal that comprises a weighted sum of 
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sinusoids such as that in Eq. (1.1) can be represented completely in the frequency domain in terms of 
the amplitudes and phase angles of its individual sinusoidal components. Below, we demonstrate that 
through the use of the Fourier 1 series, the concept of frequency spectrum can be applied to arbitrary 
periodic signals. 

In the next and subsequent sections, periodic signals are typically represented in terms of 
nonperiodic signals. To avoid possible confusion between the two types of signals we will use the 
notation x(t) for a periodic signal and simply x(t) for a nonperiodic one. Signals will be assumed to 
be real unless otherwise stated. 


2.2.1 Definition 

A periodic continuous-time signal, namely, a signal that satisfies the condition 
x{t + rr o) = x(t) for |r| = 1, 2, ... , oo 
where r () is a constant called the period of the signal, can be expressed as 


OO 

x(t) — ^2 x(t + r r 0 ) 

r——oo 


where x(t) is a nonperiodic signal given by 


x(t) = 



for — to/2 < t < to/2 
otherwise 


( 2 . 1 ) 


( 2 . 2 ) 


The time interval — tq/ 2 < t < tq/2 will be referred to as the base period hereafter. 

What the above formulas are saying is this: If a nonperiodic signal x(t) is available that fully 
describes the periodic signal x(t ) with respect to the base period, then the periodic signal x(t) can 
be generated by creating time-shifted copies of x(t), that is, x(t + r To) for r — 1, 2, ... , oo and 
r — — 1, —2, ... , —oo, and then adding them up. This replication process occurs frequently in 
DSP and it will be referred to as periodic continuation , that is, x(t) is the periodic continuation of 
x(t) in the present context. 

A periodic signal x(t) that satisfies certain mathematical requirements as detailed in Theorem 
2.1 (see Sec. 2.2.3) can be represented by the Fourier series (see Chap. 7 of Ref. [1] or Chap. 5 of 
Ref. [2]). The most general form of this important representation is given by 


OO 

x(t) = Y x ke ]ka,,t for — r 0 /2 < t < r 0 /2 (2.3) 

k=—o o 


x Jean Baptiste Joseph Fourier (1768-1830) was a French mathematician who was taught by Lagrange and Laplace. 
He got himself involved with the French Revolution and in due course joined Napoleon's army in the invasion of Egypt 
as a scientific advisor. The series named after him emerged while Fourier was studying the propagation of heat in solid 
bodies after his return from Egypt. 
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where &>o = 2it /xq. The coefficients 2 {X k } can be deduced by multiplying both sides of Eq. (2.3) by 
e -jio>ot anc [ then integrating over the base period — xq/2 < t < tq/2. Thus 



x(t)e ■ ,7<Uo, dt 



jkco 0 t e ~jlcoot dt 


OO 


= E ** 


fTo/2 


a j(k-l)o) 0 t 


dt 


I—To/2 


The change in the order of integration and summation between the first and second equations is 
allowed for signals that satisfy the conditions in Theorem 2.1. Now 


fTo/2 


e i(k-lyoot dt 


I- to/2 


to if / = k 

0 if l^k 


(2.4) 


(see Prob. 2. 1) and as x(t ) = x(t) over the base period — to/2 < t < tq/2 according to Eq. (2.2), we 
have 


X k 


I f To/2 

— / x(t)e- jk0J0 ' dt 

to J- r 0 /2 


(2.5) 


As e-’ kw °' is a complex quantity, coefficients \X k \ are complex in general but can be purely real or 
purely imaginary. 3 X k can be represented in terms of its real and imaginary parts or its magnitude 
and angle as 

X k = me X k + j 3m X k = \X k \e imgXk 

where 

\X k \ = sj(me X k ) 2 + (3m X k ) 2 and arg X k = tan' 1 ^ 

me x k 

2.2.2 Particular Forms 

The Fourier series can also be expressed in terms of a sum of sines and cosines, or just sines or just 
cosines, as will now be demonstrated. Equation (2.3) can be expanded into a sum of two series plus 
a constant as 

— 1 OO 

x(t)= E x ke ikaot + *o + E X k e ikm ‘ 

k —— oo k— 1 

and by letting 4 k —> —k in the first summation and then noting that 

1 OO 

X_ k e~ ikmt = Y X- k e~ jkmt 

k—oo k= 1 


2 The notation {X^} is used to represent the set of coefficients Xk for — oo < k < oo, which can also be represented 
more precisely by the notation {Xk: — oo < k < oo}. 

3 See Appendix A for the basic principles of complex analysis. 

4 The notation k — > —k here and in the subsequent chapters represents two variable transformations carried out in 
sequence one after the other, that is, k = —k' and k' = k. 
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we get 


m = Y. x -ke ~ ika *' + ^ x k e 


jko)Qt 


k= 1 


k=\ 


= Xo + X~k(coskcoot — j sin kcoot) 
k =1 
oo 

+ ^ X k (cos kcoot + j sin kcoot) 

k= 1 

oo oo 

= x 0 + 'Yl( Xk + cos + ^2 j( Xk ~ x ~ k ) sin 


k=l 

Now from Eq. (2.5), we have 

l cV2 

Zo = — / .v(f) eft 

T 0 J-ro/2 
J r*o/2 

X k = x(t)e- jkaj °' dt 

r 0 J-to/2 


k—\ 


[ r* o/2 

r 0 7 —t 0 /2 

l r*o/2 


x(t)(cos kcoot — j sin kcoot) dt 


l n 0/2 

x(t) cos kcoot dt — j — / x(t) sin kcoot dt 
r 0 J —to/2 t 0 7 -t 0 /2 

J /-to/2 

Z_* = - x(t)e jkmt dt 

T 0 J—tq/2 


J pro/2 

TO 7—t 0 /2 

1 pTo/2 


x(t)(cos kcoot + j sin kcoot) dt 


1 (-To/2 

x(t) cos kcoot dt + j — / x(t) sin kcoot dt 
To 7-t 0 /2 To 7-t 0 /2 


and hence Eqs. (2.7b) and (2.7c) give 


2 / > ' r °/ 2 

Z* + X_ k = — / x(t) cos kcoot dt 
To J-ro/2 

j(X k — X_ k )= — / xit) sin kcoot dt 
To 7— to/2 

*-* = xl 


( 2 . 6 ) 


(2.7a) 


(2.7b) 


(2.7c) 


(2.8a) 

(2.8b) 

(2.8c) 
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where X k is the complex conjugate of X k . On using Eqs. (2.7a), (2.8a), and (2.8b), Eq. (2.6) can also 
be expressed as 


where 


OO 


x(t) = iflo + \](a k cos kcoot + b k sin kcoot) 

(2.9) 

k= 1 


2 r ro/1 

ao = 2 Xq — — / x(t)dt 

T 0 J— t 0 /2 

(2.10a) 

2 f To/2 

a k = Xk + X- k = — / x(t) COS kcoot dt 

To J- 1 0 /2 

(2.10b) 

2 r r °/ 2 

b k — j(X k — X_ k ) = x(t) sinkcoot dt 

To J-to /2 

(2.10c) 


The 1/2 in the constant term of Eq. (2.9) is used to make the formula for <7o in Eq. (2.10a) a special 
case of the formula for a k in Eq. (2.10b). These equations are often referred to as the Euler or 
Euler-Fourier formulas. 

Equation (2.9) gives the Fourier series in terms of sines and cosines. As sines can be converted 
to cosines and vice versa, a representation of the Fourier series in terms of just sines or just cosines 
can be readily obtained. If we let 


a k = A k cos <pk and b k — —A k sin^. 


( 2 . 11 ) 


then parameters {A k } and {<p k } can be expressed in terms of {a k } and {b k } or {X^-} as 


Aq = |ool = 2|Xo| 


</>o 


0 if flo or Xq > 0 

—it if flo or Xq < 0 


A k — \Jci k +b~ k — 2\X k \ 

-i ( b k\ 

<t> k = tan-= arg X k 

\ a-kj 


(2.12a) 

(2.12b) 

(2.12c) 

(2.12d) 


(see Prob. 2.2). Now on eliminating coefficients flo, a k , and b k in Eq. (2.9) using Eq. (2.11), the 
Fourier series can be put in the form 

OO 

x(t) = \A 0 cos 0 o + E A*.(cos fa cos kcoot — sin fa sin kco^t) 
k= 1 

OO 

= \ Ao cos 0o + A)t(cos kcoot cos fa — sin kcoot sin fa) 

k= 1 
oo 

= \ A 0 cos 0q + ^ A k cosikcopt + fa) (2.13a) 

k=\ 

oo 

= \ Ao sin(0 o + \n~) + ^ A k sin (kcoot + <f> k + \tt 

k= 1 


(2.13b) 
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In summary, the Fourier series can be used to express a periodic signal in terms of an infinite 
linear combination of exponentials as in Eq. (2.3), in terms of sines and cosines as in Eq. (2.9), 
just cosines as in Eq. (2.13a), or just sines as in Eq. (2.13b). Engineers often refer to the sinusoidal 
component of frequency mo as the fundamental and to those of frequencies km o for k = 2, 3,..., 
as the harmonics. The terms in Eq. (2.9), ^Aocosfio in Eq. (2.13a), and ^Aosin(0o + tt/ 2) 
in Eq. (2.13b) are alternative ways of representing the zero frequency component and can assume 
positive or negative values. 

The set of coefficients { Xj: — oo < k < oo} in Eq. (2.5), the sets of coefficients {ak} and 
{/?£-} in Eq. (2.9), and the corresponding amplitudes and phase angles of the sinusoids in Eq. (2.13b), 
that is, {Ai-: 0 < k < oo} and {<pk : 0 < k < oo}, respectively, constitute alternative but complete 
descriptions of ihe frequency spectrum of a periodic signal. The coefficients {AT} are closely related to 
the Fourier transform of the nonperiodic signal x(t), as will be demonstrated in Sec. 2.3.1, and, for this 
reason, they will receive preferential treatment in this book, although the alternative representations 
in terms of } and {bk} or {A*} and { <pk } will also be used once in a while. The magnitude and phase 
angle of AT, that is, |AT| and arg AT, viewed as functions of the discrete frequency variable km o for 
—oo < kc wo < oo, will henceforth be referred to as the amplitude spectrum and phase spectrum, 
respectively. 

The periodic signal x(t) in the above analysis can be symmetrical or antisymmetrical with 
respect to the vertical axis. If it is symmetrical, signal x(t) in Eq. (2.2) is an even function of time 
since 


x(—t) = x(t ) 

We know that cos cot is an even and sin mt is an odd function of time, that is, 
cos (—mt) = cos mt and sin(— mt) — — (sin cot) 

and hence x(t) cos kmot is even and x(t) sin kmot is odd. Consequently, Eqs. (2.7a)-(2.7c) give 


1 p 6/2 2 f T °l 2 

Xq — — / x(t)dt — — / x(t)dt 
T 0 J —tq/2 To J 0 

1 yTo/2 j p 0 /2 

AT = — / x(t) cos kmot dt — j — / x(t) sin kmot dt 

To J- r 0 /2 To J-t 0 /2 

to/2 

x(t) cos kmot dt for k = 1 , 2, ... 

I po/2 j po/2 

A '-k = — / x(t) cos kmot dt + j— / x(t) sin kmot dt 

To J- r 0 /2 To J- 1 0 /2 

to/2 

x(t) cos kmot dt for k— 1 , 2, ... 


~ 

TO JO 



(2.14a) 


(2.14b) 


(2.14c) 


that is. 


X_ k = AT for k= 1 , 2, ... 
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and from Eqs. (2.10a)-(2.10c), we get 

4 n 0/2 

ao — 2 Xq — — / x(t)dt 
to Jo 

4 r T o/ 2 

Qk — Xk + = — / x(t) cos, kcoQt dt 

T o Jo 

= j'CK* - *_*) = 0 for k = 1, 2, ... 


for A = 1, 2, ... 


(2.15a) 

(2.15b) 

(2.15c) 


On the other hand, if x(/) is antisymmetrical about the vertical axis, then x(t) is an odd function and 
thus x(t ) cos kmot is an odd function and x(t) sin kcoot is an even function. In this case, Eqs. (2.7a)- 
(2.7c) give 


(2.16a) 



1 

r T o/~ 


X 0 = 


/ 

o 

II 


TO J 

'-to/2 



1 

r to/2 

[ /-to/2 

X k = 


/ 

x(t) cos kcoot dt — j — / 


TO J 

'-to/2 

r 0 J —to/2 


r T o/2 


-J— \ 
to Jo 

1 /* t o/2 


;t(f) sinA:a)ot dt 


x(t) sinkcoot dt 
for A- = 1,2,... 


j r*o/2 

X_k= — I x(t) cos k coot dt + j— / x(t) sin kcoot dt 

to J—tq/ 2 to J—xq/2 

2 r z ° /2 

— j — / x(t) sin ka>ot dt for A = 1 , 2, ... 
to Jo 


(2.16b) 


(2.16c) 


that is. 


X-* = -x* 


for A = 1, 2, ... 


and from Eqs. (2.10a)-(2.10c), we get 

flo = 2Xq = 0 

cik — Xk + X-k = 0 for A = 1, 2, 
b k = j(X k - X_ k ) = 2jX k 

4 r T o/2 

to Jo 


x{t)sinka>ot dt for A= 1, 2, ... 


(2.17a) 

(2.17b) 

(2.17c) 

(2.17d) 


In effect, if x(t) is antisymmetrical, then the DC component, which is the average value of the 
waveform, is zero. 


2.2.3 Theorems and Properties 

Fourier series have certain theoretical properties that are often of considerable practical interest. A 
few of the most important ones are described below in terms of a number of theorems. 

To start with, we are quite interested in the circumstances under which the substitution of the 
coefficients given by Eq. (2.5) in the Fourier series of Eq. (2.3) would yield the periodic signal x(t). 
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Theorem 2.1 Convergence Ifx(t) is a periodic signal of the form 

OO 

x(t) = ^2 x(t + rro) 

r=—oo 

where x(t) is defined by Eq. (2.2), and over the base period —to/2 < t < to/2 x(t) 

• has a finite number of local maxima and minima 

• has a finite number of points of discontinuity 

• is bounded, that is, 

|*(0| < K < oo 

for some positive K, then the substitution of coefficients {A k ) given by Eq. (2.5) in the Fourier 
series ofEq. (2.3) converges to x(t) at all points where x(t) is continuous. 

At points where x(t) is discontinuous, the Fourier series converges to the average of the 
left- and right-hand limits of x(t), namely, 

x(t d ) = \\x(t d ~) + x(t d + )\ 

as illustrated in Fig. 2.1 where the left- and right-hand limits of x(t ) att — t d are defined as 
x(t d — ) = limxfe — lei) and x(t d + ) — lim x(t d + lei) 

e—>0 e—>0 

Proof (See pp. 225-232 of Ref. [3] for proof.) A 

The prerequisite conditions for convergence as stated in Theorem 2.1 are known as the 
Dirichler conditions (see Ref. [4]). 


5 Johann Peter Gustave Lejeune Dirichlet (1805—1859) was bom in Diiren, a town between Aachen and Cologne. In 
addition to his work on the Fourier series, he contributed a great deal to differential equations and number theory. He married 
one of the two sisters of the composer Felix Mendelssohn. 
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In the above analysis, we have tacitly assumed that the periodic signal x (?) is real. Nevertheless, 
the Fourier series is applicable to complex signals just as well. Furthermore, the variable need not 
be time. In fact, the Fourier series is often used to design certain types of digital filters, as will be 
demonstrated in Chap. 9, and in that application a function is used, which is periodic with respect 
to frequency, that is, the roles of time and frequency are interchanged. In the following theorem, 
signal x(t) is deemed to be complex but the theorem is, of course, valid for real signals as well. The 
theorem provides a relation between the power associated with a periodic signal and the Fourier-series 
coefficients of the signal. 

Theorem 2.2 Parseval’s Formula for Periodic Signals The mean of the product x(t)x* it), 
where x*(t) is the complex conjugate ofx(t), can be expressed in terms of the Fourier-series 
coefficients {A - *} as 

_ 1 r T o/ 2 1 rW2 

x(t)x*(t) — — / x(t)x*(t)dt — — / \x(t)\ 2 dt 

n J—tq /2 n J—tq /2 

oo oo 

= E ***** = E i**i 2 (2 - 18 ) 

k——oc k=—oo 

See footnote on Parseval 6 . 

Proof The mean of the product x(t)x*(t) is defined as 

_ j n 0/2 

x(t)x*(t) = / x(t)x*(t)dt (2.19) 

2"0 J—zo/2 

Hence, Eqs. (2.3) and (2.19) give 



For signals that satisfy Theorem 2.1, the order of summation and integration can be interchanged 
and thus 


i(t)x*(t) = V x k Y X? • — / e j(k ~ ,)mt dt 
E i^oo r ° •'- 0/2 


r»T 0 /2 


6 Marc-Antoine Parseval de Chenes (1755-1836) was a French mathematician of noble birth who lived in Paris during 
the French Revolution. He published some poetry against Napoleon’s regime, which nearly got him arrested. 
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Now the value of the integral is equal to to if / = k and zero otherwise, according to Eq. (2.4). 
Therefore, 


OO 

x(t)x*(t) = J2 X k x l = \ x k\ 2 ^ 

k——oo 

For a real x(t), we have x*(t ) = x(t ) and hence Parseval’s formula in Eq. (2.18) assumes the 
simplified form 


x 2 (t ) 


1 

to 



OO 

x 2 (t) dt — Y X k X k 

k=—o O 


E i^-i 2 


( 2 . 20 ) 


where x 2 (t) is the mean square value of the periodic signal x(t). 

If x(t) represents a voltage across or a current through a resistor then the mean square of x(t) 
is proportional to the average power delivered to the resistor. In effect, Parseval’s theorem provides 
a formula that can be used to calculate the average power by using the Fourier-series coefficients. 


Theorem 2.3 Least-Squares Approximation A truncated Fourier series for a real periodic 
signal x (t) of the form 

N 

x\t) = Y x ke jku *'‘ (2.21) 

k=-N 

is a least-squares approximation of x(t) independently of the value of N. 

Proof Let 

N 

y{t)= Y Y ke jkmt (2.22) 

k=-N 

be an approximation for x(t) and assume that e(t) is the error incurred. From (2.3) and (2.22), 
we can write 


e(t) = x(t) - y(t) 

oo N 

= Y x ke jkc00 ' - Y Y ke jko>ot 

k— —oo k=—N 

oo 

= Y E k ejka> °' 

*=-oo (2.23) 


where 


E k 


X k - Y k for -N < k < N 
X k for |£| > N 


On comparing Eq. (2.23) with Eq. (2.3), we conclude that Eq. (2.23) is the Fourier series of 
the approximation error, e(t), and by virtue of Parseval’s theorem (that is, Eq. (2.20)), the 
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mean-square error is given by 

oo 

W)= Y i^-i 1 2 * * 

k=—o o 
N 

= y \Xk-Y k \ 2 + Y i^i 2 (2 - 24 ^ 

k=-N |jt|>iV 

The individual terms at the right-hand side of Eq. (2.24) are all positive and, therefore, e 2 (t) is 
minimized if and only if 


that is, 


Y k = X k for -N <k< N 


N N 

y(t) = Y Y k e ikmot = Y Xke ]k " w = x'{t) 

k=—N k=-N 


That is, the approximation y(t) of x(t) that minimizes the mean-square error incurred is the 
truncated Fourier series of Eq. (2.21). Such an approximation is said to be a least-squares 
approximation. A 

Theorem 2.4 Uniqueness If two periodic signals x\(t) and X 2 (t) are continuous over the 
base period and have the same Fourier-series coefficients, that is, { X k [} = { X k2 }, then they 
must be identical, that is, Jci (t) — X 2 (t). 

Proof (See p. 487 in Ref. [1] for proof.) A 

The theorem also applies if the signals have a finite number of discontinuities over the base 
period provided that the values of .ri(f) or X 2 (0 at each discontinuity are defined as the average of 
the left- and right-hand limits as in Theorem 2.1. 

A consequence of the uniqueness property is that an arbitrary linear combination of sines, or 
cosines, or both, such as Eq. (1.1), for example, is a unique Fourier series of a corresponding unique 
periodic signal. 

The application of the Fourier series will now be illustrated by analyzing some typical periodic 
waveforms. 


Example 2.1 


The periodic pulse signal x(t) shown in Fig. 2.2 a can be represented by Eq. (2.1) 
with x(t) given by 7 


x{t) = p T (t) = 


for — to/2 < t < — r/2 
for — r/2 < t < r/2 
for r/2 < t < xq/2 


1 The values of the pulse function at the points of discontinuity t = —r/2 and r/2 should, in theory, be defined to be 

j to make the function consistent with Theorem 2.1. However, this more precise but more complicated definition would not 

change the Fourier series of the function since the integral in Eq. (2.5) would assume an infinitesimal value when evaluated 

over an infinitesimal range oft, c. 
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S( 

t) 

1 





f 

t t f 


^ -i 1 To 
~ 2 ~ 2 2 ~~ 2 ~~ 

(a) 



(b) 

Figure 2.2 Periodic signals: (a) Pulse signal, (b) rectified sinusoid. 


with to = 2tt/ o>(). (a) Obtain the Fourier series of x(t) in terms of Eq. (2.3). ( b ) Obtain and 
plot the amplitude and phase spectrums. 


■ Solution 


As x(t) is symmetrical with respect to the vertical axis, it is an even function of t and 
Eqs. (2.14a) and (2.14b) apply. We note that Eq. (2.14a) can be obtained from Eq. (2.14b) 
by letting k — 0 and hence, for any k, we have 


Thus 


2 r To/2 2 f z/1 

Xk = — / x(t) cos kcoot dt = — / cos kcoQt dt 
to Jo Tq Jo 


2 

To 


sin kooot 
ku> o 


t/2 


J 0 


r sin kcoo t/ 2 
to kcoor/2 


(2.25) 


l^| 


for k = 0 
To 

r smkcoor/2 


Tq kco qt/2 


otherwise 
























THE FOURIER SERIES AND FOURIER TRANSFORM 41 


Amplitude spectrum 



Phase spectrum 
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Figure 2.3 Frequency spectrum of periodic pulse signal (Example 2.1): (a) Amplitude 
spectrum, ( b) phase spectrum. 


and 


arg X k = 



if X k > 0 
if X k < 0 


The amplitude and phase spectrums of the signal for to = 1 s and r = r 0 /2 are plotted 
in Fig. 2.3 a and b. 


The periodic pulse signal analyzed in the above example is of interest in a number of applica¬ 
tions, for example, in A/D and D/A converters (see Chap. 6). 


Example 2.2 


The periodic waveform depicted in Fig. 2.2 b can be represented by Eq. (2.1) 
with x(t) given by 


x(t) = |sin \(jL>at 


for - \xq <t < 
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and to = 2tc /(»{). (a) Obtain its Fourier-series representation in terms of Eq. (2.3). (b) Obtain 
and plot the amplitude and phase spectrums of x(t). (c) Express the Fourier series obtained in 
part (a) as a linear combination of sines. 


■ Solution 

(a) As x(t ) is an even function of t, Eqs. (2.14a) and (2.14b) give 



■ro/2 


2 


L 


■ro/2 


x(t) cos ka>ot dt = 


sin cos kcoot dt 


2 


l 


■ro/2 


cos kcoot sin ^coot dt 


From trigonometry 


cos 9 sin \[r = j[sin(0 + x[r) — sin(0 — i [/)] 


and hence we obtain 




On evaluating the limits, straightforward manipulation gives 


k TV (l — 4£ 2 ) 


Thus for any value of k including zero, we have 


2 

7T (1 — 4A: 2 ) 


and 



if k = 0 
otherwise 
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Amplitude spectrum 



Phase spectrum 



Frequency, rad/s 

(b) 


Figure 2.4 Frequency spectrum of rectified waveform (Example 2.2): (a) Amplitude 
spectrum, (b) phase spectrum. 


( b ) From Eqs. (2.12a)-(2.12d), we have 


A k = 2\X k \ = 


7T (1 — 4k 2 ) 


for k > 0 


<Pk = arg X k = 


0 

-7r 


if k = 0 
for k > 0 


The amplitude and phase spectrums of the waveform are illustrated in Fig. 2.4 for the 
case where ® 0 = 1 rad/s. 

(c) Now Eq. (2.13b) yields 


n. 

x(t) = —+ 

* tr 

= w + 3T sin ("o' - 5*) 
+ 3 ^ sin ( 3 wot - iff) 


4 

ff (l — 4& 2 ) 


sin \ ka>ot — n + \tt J 

+ BT sin ( 2 ®o? - 

+ ^ sin (4a> 0 f - jff) H- ■ 
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The waveform analyzed in Example 2.2 is essentially a sinusoidal waveform with its negative 
half cycles reversed and is the type of waveform generated by a so-called full-wave rectifier circuit. 
Circuits of this type are found in AC-to-DC adaptors such as those used to power laptop or handheld 
computers and modems. The Fourier series obtained shows that an AC supply voltage of amplitude 
1 V 8 would produce a DC output voltage of 2/7r V. Hence, an AC voltage of amplitude 170 V would 
produce a DC voltage of 108.23 V. We note also that there would be an infinite number of residual AC 
components with frequencies co o, 2&>o, 3&>o, 4&>o, ... , namely, the fundamental and harmonics, with 
amplitudes, of 72.15, 14.43, 6.18, 3.44 V,..., respectively. In good-quality AC-to-DC adaptors, the 
amplitudes of the harmonics are reduced to insignificant levels through the use of analog filter circuits. 


Example 2.3 


(a) Obtain the Fourier series of the periodic signal shown in Fig. 2.5 a in terms 
of Eq. (2.3). ( b ) Obtain and plot the amplitude and phase spectrums of x(t). 


■ Solution 


(a) The signal in Fig. 2.5 a can be modeled by using shifted copies of p z / 2 (t) for the 
representation of signal x(t') in Eq. (2.2), where p z (t) is the pulse signal of Example 2.1, 
that is, we can write 

X(t) = Pz/2 (t + ±t) - p z /2 (t - \t) 

As x{t ) is antisymmetrical with respect to the vertical axis, it is an odd function of time. 
Hence, from Eq. (2.16a), we get 

*o = 0 


Now from Eq. (2.16b), we have 


X k 


2 pal 2 

— j— I x(t) sin ka>ot dt 
T o Jo 

2 f T °/ 2 

-j— I Pt /2 (j - \r) sin kco 0 t dt 
r o Jo 

2 f t/2 

—j — / — sin kcootdt 


M) Jo 


ro 


— cos ka>ot 

r/2 2 

1 — cos ku>QT / 2 

kw o 

- J 

o r 0 

k(!L)Q 


.4sin"A:a>oT/4 
J kmoxo 


for k = 1, 2, 


The symbol V stands for volts. 













Magnitude 
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Time domain 



Time, s 
(a) 


Amplitude spectrum 



Frequency, rad/s 



-50 0 50 

Frequency, rad/s 


(b) 


(c) 


Figure 2.5 Frequency spectrum (Example 2.3): (a) Time-domain representation, 
(b) amplitude spectrum, (c) phase spectrum. 


that is, 


X k 



for k = 0 

for k = 1, 2, ... 
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(. b ) The amplitude and phase spectrums are obtained as 


\X 0 \ = 0 


and 


\*k\ = 


kn 


kjtr 

2r n 


arg X 0 = 0 


for k = 1, 2, ... ■ 


! j 7r if k > 0 

0 if A: = 0 

— ^7T if fe < 0 


for k = 1, 2, ... ■ 


(See Fig. 2.5 b and c for plots.) 


Example 2.4 


Deduce the Fourier series of the following periodic signal 
x(t) — sin 4 coot 


in terms of cosines. 

■ Solution 

We can write 

x(t) = (sin 2 coot) 2 = [1(1 — cos2a>o0]~ 

= | (l — 2 cos 2a>ot + cos 2 2®o?) 

= \ [l — 2cos2&>of + t( 1 + cos4cuof)] 

= — 2cos2&>ot + \ cos4ftiof) 

= | — j cos 2a>ot + | cos 4coot ■ 

The above is a Fourier series and by virtue of Theorem 2.4, it is the unique Fourier series 
for the given signal. 


2.3 FOURIER TRANSFORM 

The Fourier series described in the previous section can deal quite well with periodic signals but, 
unfortunately, it is not applicable to nonperiodic signals. Periodic signals occur in a number of 
applications but more often than not signals tend to be nonperiodic, e.g., communications, seismic. 
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or music signals, and for signals of this type some mathematical technique other than the Fourier 
series must be used to obtain useful spectral representations. 

A mathematical technique that can deal quite effectively with nonperiodic signals is the Fourier 
transform [5]. This can be defined as an independent transformation. Alternatively, it can be deduced 
from the Fourier series by treating a nonperiodic signal as if it were periodic and then letting the 
period approach infinity [2]. The latter approach provides a fairly accurate physical interpretation of 
a somewhat abstract mathematical technique and will, therefore, be pursued. 


2.3.1 Derivation 

Let us consider the nonperiodic pulse signal of Fig. 2.6 a, which comprises just a single pulse. This 
signal can, in theory, be deemed to be the special case of the periodic pulse signal x(t) shown in 
Fig. 2.2 a when the period To is increased to infinity, that is, 

x(t) = lim x{t) — p T (t) 

T 0 —>-00 


The Fourier series of the periodic pulse signals was obtained in Example 2.1 and its Fourier-series 
coefficients {AT} are given by Eq. (2.25). If we replace kcoo by the continuous variable u>, Eq. (2.25) 
assumes the form 


r &mkwQr/2 r sin cur/2 

To kcoat/2 To cut/2 

Let us examine the behavior of the Fourier series as the period xq of the waveform is doubled to 
2 to, then doubled again to 4 to, and so on, assuming that the duration x of each pulse remains fixed. 
Using a simple MATLAB program with To = 1 and x = ^ s, the plots in Fig. 2.6 b can be readily 
obtained. Two things can be observed in this illustration, namely, the magnitudes of the Fourier- 
series coefficients {A'*} are progressively halved because AT is proportional to x/xq, whereas the 
number of frequency components is progressively doubled because the spacing between adjacent 
harmonics is halved from &>o to \a>o, then to jU>o, and so on. Evidently, if we were to continue 
doubling the period ad infinitum, the coefficients {AT} would become infinitesimally small whereas 
the number of harmonics would become infinitely large and the spacing between adjacent harmonics 
would approach zero. In effect, applying the Fourier series to the periodic pulse signal of Fig. 2.2a 
and letting To —> oo would transform the signal in Fig. 2.2a to the nonperiodic pulse signal of 
Fig. 2.6a but as X k —> 0, the approach does not yield a meaningful spectral representation for the 
nonperiodic pulse signal of Fig. 2.6a. The same problem would arise if one were to apply the Fourier 
series to any nonperiodic signal and, therefore, an alternative spectral representation must be sought 
for nonperiodic signals. 

The previous analysis has shown that as To -> oo, we get coq —> 0 and AT —>■ 0. However, the 
quantity 


X(jco) = lim X(jkcoo) = 

T 0 ->OO 


x k 

lim — 

T 0 ->OO To 


(2.26) 
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Time, s 
(a) 



Frequency, rad/s 

( b ) 


Figure 2.6 (a) Pulse function. ( b ) Fourier-series representation of the pulse signal shown in Fig. 2.2 a for 

pulse periods of To, 2 tq, and 4 tq. 


where a> — kcoQ and /o = l/to = coo/2tc is the frequency between adjacent harmonics in Hz, 
assumes a finite value for a large class of signals and, furthermore, it constitutes a physically mean¬ 
ingful spectral representation for nonperiodic signals. As will be shown in Theorem 2.16, \X(jco)\ 2 
is proportional to the energy density of signal x(t) per unit bandwidth in Hz at frequency / = 
0)/{2tt) in Hz. 
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From Eqs. (2.26) and (2.5), we can write 


X(jkcoo) = = r 0 X k 

Jo 


rV2 

J- ro/2 


x(t)e 


-jkaxjt 


dt 


and therefore, 


X(jco ) = lim X(jkcoo) 

T 0 —^OO 

or 

/ oo 

x(t)e- j<0 ‘ dt (2.27) 

-OO 

The quantity X( jo>) is known universally as the Fourier transform of nonperiodic signal x(t). 

If the Fourier-series coefficients of a periodic signal are known, then the signal itself can be 
reconstructed by using the formula for the Fourier series given by Eq. (2.3), namely, 

OO 

x(t) = X k e^ kt00 ' for — ro/2 < t < ro/2 

k= —oo 

As before, a nonperiodic signal can be generated from a periodic one by letting to —> oo in x(t ), that is, 

OO 

x{t) = lim x(t) = lim V'' X k e-’ ka ’° t for —ro/2 < t < ro/2 (2.28) 

Tq—>• OO Tq—^OO J 

k— —oo 


From Eq. (2.26), we have 


X(jkcoo) = 


X k 

coq / 2 jr 


or 


X(jkcoo)co 0 
Xk= 2 jt 


and hence Eq. (2.28) assumes the form 

j 

x(t) = lim — y X(jk(L>o)e jko)ot coq 

To ^ oo Z7T z —' 
k=—oo 


for —ro/2 < t < ro/2 
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If we now let kco o = co and o>q = Aco, then as r n —>■ oc the above summation defines an integral. 
Therefore, 

1 r°° 

x(t) = — / X(jco)e ja>t dco (2.29) 

2 7T J_ oo 

This is referred to as the inverse Fourier transform of X( jo>) because it can be used to recover the 
nonperiodic signal from its Fourier transform. 

A nonperiodic signal can be represented by a Fourier transform to the extent that the integrals 
in Eqs. (2.27) and (2.29) can be evaluated. The conditions that would assure the existence of the 
Fourier transform and its inverse are stated in Theorem 2.5 in Sec. 2.3.3. 

The Fourier transform and its inverse are often represented in terms of operator notation as 

X(jco) = Tx(t) and x{t) — T~ x X(jco) 

respectively. An even more economical notation, favored by Papoulis [5], is given by 

x(t) ** X{jco) 

and is interpreted as: X ( jco ) is the Fourier transform of x(t), which can be obtained by using Eq. (2.27), 
and x(t ) is the inverse Fourier transform of X(jco), which can be obtained by using Eq. (2.29). The 
choice of notation depends, of course, on the circumstances. 

Like the Fourier series coefficients of a periodic signal, X(jco) is, in general, complex and it 
can be represented in terms of its real and imaginary parts as 

X(jco) = 3\e X(jco) + j 3m X(jco) 

Alternatively, it can be expressed in terms of its magnitude and angle as 

X(jco) = A(co)e mo>) 

where 

A(co) = \X(jco)\ = ^[V\e X(jco)] 2 + [3m X(jco)] 2 (2.30) 


and 


, 3m X( jco) 

4>(cn) = arg X{jco) = tan (2.31) 

meX(jcn) 

As physical quantities, the magnitude and angle of the Fourier transform are the amplitude spectrum 
and phase spectrum of the signal, respectively, and the two together constitute its, frequency spectrum. 

A fairly standard practice, is to use lower-case symbols for the time domain and upper-case 
symbols for the frequency domain. This convention will as far as possible be adopted throughout 
this textbook to avoid confusion. 

2.3.2 Particular Forms 

In the above analysis, we have implicitly assumed that signal x (t) is real. Although this is typically the 
case, there are certain applications where x(t) can be complex. Nevertheless, the Fourier transform 
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as defined in the previous section continues to apply (see Ref. [5]), that is, 
Tx{t) = T\$\e x(f) + j Jm x(f)] 

/ oo 

[J\e x(f) + j Jm x(t)]e~ j(ot dt 

-OO 

/ OO 

[J\ex(t) + j Jm x(r)][cosftjf — j sin <wt] dt 

-OO 

= J\e X(jco) + j Jm X(jco ) 

where 

/ OO 

{J\e[x(t)] cos cot + Jm[x{t )] sin&tf} dt 

-OO 

/ OO 

{J\e[x(t)\ sincuf — Jm[x(t)] cos cot} dt 

-OO 

If x(t) is real, then Eqs. (2.32b) and (2.32c) assume the forms 

/ OO 

x(f)cos cot dt 

-OO 

poo 

JmX(jco) = — / x(t)sina>t dt 


(2.32a) 

(2.32b) 

(2.32c) 

(2.33a) 

(2.33b) 


As the cosine is an even function and the sine is an odd function of frequency, we conclude that the 
real part of the Fourier transform of a real signal is an even function and the imaginary part is an odd 
function of frequency. Hence, 


X(-jco) = J\e X(-j(o) + j Jm X(-jco) 

= X(jw) - j Jm X(jco) 

= X*{j(o) (2.34) 


that is, X(—jco) is equal to the complex conjugate of X(jco). It also follows that the amplitude 
spectrum given by Eq. (2.30) is an even function and the phase spectrum given by Eq. (2.31) is an 
odd function of frequency. 

For a real x(f), the inverse Fourier transform can be expressed as 


x(0 = T [J\e X(jco) + j Jm X(jco)] 

1 


2n J_r 


[J\e X(jco) + j Jm X(j(o)]e JO>t dco 


= — [J\e X(jco) + j Jm X(ja>)][cos cot + j sin cot] dco 
J_m 


— —— / {9\e[X(j co)] cos cot — Jm[X(jco)\ sin cot] dco 

2n oo 


(2.35a) 
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since the imaginary part is zero. The product of two odd functions such as 3m[X(jo>)] sin air is an 
even function and thus we can write 


x(t) = — / me[X(jco)e jo,t ] dco 

J—no 


= - me 

7X 


X{joo)e i<0, doo 


L -/0 


(2.35b) 


If the signal is both real and an even function of time, that is, x(—t) — x(t), then Eqs. (2.33a) and 
(2.33b) assume the form 


poo 

9\eX(ja>) = 2 / x(t) cos cot dt (2.36a) 

Jo 

3m X(joo) = 0 (2.36b) 

that is, the Fourier transform is real. As the imaginary part of the Fourier transform is zero in this 
case, Eq. (2.35a) assumes the form 


i r°° 

x{t) = / 3\e[X(jcL>)] cos ait du> (2.36c) 

JT Jo 

The converse is also true, i.e., if the Fourier transform is real, then the signal is an even function of 
time. 

If the signal is both real and an odd function of time, that is, x(—t) = —x(t), then Eqs. (2.33a) 
and (2.33b) assume the form 


X(jco) = 0 (2.37a) 

poo 

3m X(joj) = —2 / x(t) sinwr dt (2.37b) 

Jo 

and from Eq. (2.35a), we get 

1 

x(t) = -/ Jm[X(j(a)\ sinwf dm (2.37c) 

n Jo 

The above principles can be extended to arbitrary signals that are neither even nor odd with 
respect to time. Such signals can be expressed in terms of even and odd components, x e (t) and x a (t), 
respectively, as 


x{t) — x e (t) + x 0 (t) 


(2.38a) 


x e (t) = \[x{t) + x{-t)] 
X 0 (t) = \[x(t) - x(-t)] 


where 


(2.38b) 

(2.38c) 
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From Eq. (2.38a) 

X(joj) = Vie X(jco) + j 3m X(jco) = X e (jco) + X 0 (ja> ) (2.39) 

and as X e {jco) is purely real and X 0 (jco) is purely imaginary, we have 

x e (t) Vie X(jco) (2.40a) 


where 


and 


where 


VieX(ja>) = 2 / x e (t)coscot dt 


x e (t) — — / V\e[X(jco)] cos cot dco 
tt ,/n 


x 0 (t) -o- j 3m X(jco) 


(2.40b) 

(2.40c) 

(2.41a) 


3mX{jco)——2 / x 0 (t) sinwf dt 


x 0 (t) = -/ 3m[X(j co)] sin cot dco 

tt Jo 


(2.41b) 

(2.41c) 


Occasionally, signals are ‘right-sided’ in the sense that their value is zero for negative time, 9 that 
is, x{t) = 0, for t < 0. For such signals, x(— t ) = 0 for t > 0 and hence Eqs. (2.38b) and (2.38c) give 


x(t) = 2 x e (t) — 2 x 0 (t) (2.42a) 

and from Eqs. (2.40c) and (2.41c), we have 

2 

x(t) = — / V\e[X(jco)] cos cot dco 
it Jo 

2 

— -/ 3m[X(jco)] sin cot dco 

Tt Jo 

For this particular case, the real and imaginary parts of the Fourier transform are dependent on each 
other and, in fact, one can readily be obtained from the other. For example, if Vie X(jco) is known, 
then x(t) can be obtained from Eq. (2.42b) and upon eliminating x(t) in Eq. (2.33b) 3m X(jco) can 
be obtained. 


(2.42b) 

(2.42c) 


9 Such signals have often been referred to as causal signals in the past but the word is a misnomer. Causality is a system 


property as will be shown in Chap. 4. 
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It should be emphasized here that the relations in Eq. (2.42) are valid only for t > 0. For 
the case t = 0, x(t) must be defined as the average of its left- and right-hand limits at t = 0, to 
render x(t ) consistent with the convergence theorem of the Fourier transform (see Theorem 2.5), 
that is, 


*(0) = i[^(0-) + *(0+)] = jx(0+) 

1 f°° 

= D\e[X(jco)]dco 

n Jo 


The Fourier transform will now be used to obtain spectral representations for some standard 
nonperiodic waveforms. 


Example 2.5 


(a) Obtain the Fourier transform of the nonperiodic pulse signal shown in 
Fig. 2.6 a. (b) Obtain and plot the amplitude and phase spectrums of x(t). 


■ Solution 


(a) From Fig. 2.6 a, the pulse signal can be represented by 


Hence 


x(t) = p T (t) = 



for — r/2 < t < r/2 
otherwise 




e- jQ, ‘ dt 


' e ~J 0)1 1 T / 2 2 — e -i“ r / 2 ) 

.-j°> J-t/2 2 jco 

2 sin&>t/2 
co 


or 


2 sin cor /2 

Pz(t) - ■ 

co 

where (2 sin cor/2)/co is often referred to as a sine function. 
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Amplitude spectrum Phase spectrum 



Figure 2.7 Frequency spectrum of pulse (Example 2.5): (a) Amplitude spectrum, ( b ) phase 
spectrum. 


( b ) The amplitude and phase spectrums are given by 

2 sinwr/2 


= |X(a))| = 


t p(co ) = argZ(cu) 



if 

if 


2 sin cot / 2 

- — > 0 

CO 

2 sin ®t/2 

-— < 0 

CO 


and are illustrated in Fig. 2.7. Note the continuous frequency spectrum of the nonperiodic 
pulse signal in contrast to the discrete frequency spectrum of the periodic pulse signal 
depicted in Fig. 2.3. 


Example 2.6 


(i a ) Obtain the Fourier transform of the decaying exponential signal 
x(t ) = u(t)e~°" 
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where a is a positive constant and 

f 1 for t > 0 

u{t) = { 

[0 for f < 0 

is known as the unit-step function, (b) Obtain and plot the amplitude and phase spectrums of 
x(t). 


■ Solution 


(a) We can write 


X(jco) = 


u(t)e-°“e- j0>, dt= / e - (a+]a)t dt 


e -(u+ja>)t - 

a + jco J o 


For a > 0, we note that 


lim e~ at 0 

t—>OQ 


and as a result 


lim e ( - a - j<o)t = lim (e~ at ■ e~ }e *) 0 

t—too t— MX) V 7 


Thus 


X(jco) = 


u(t)e 011 o 


1 


a + jco 

1 


a + jco 

( b) The amplitude and phase spectrums of the signal are given by 


1 co 

A(co) — - and </>(«) = — tan — ■ 

Va 2 + tt> 2 a 

respectively. Note that certain ambiguities can arise in the evaluation of the phase spec¬ 
trum as the above equation has an infinite number of solutions due to the periodicity of 
the tangent function (see Sec. A.3.7). 


(See Fig. 2.8 for plots.) 
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Time domain 



Amplitude spectrum 




-5 0 5 

Frequency, rad/s 


(b) 


(c) 


Figure 2.8 Frequency spectrum of decaying exponential (Example 2.6 with a = 0.4): 
(a) Amplitude spectrum, (b) phase spectrum. 


2.3.3 Theorems and Properties 

The properties of the Fourier transform, like those of the Fourier series, can be described in terms of 
a small number of theorems as detailed below. 






























58 DIGITAL SIGNAL PROCESSING 


Theorem 2.5 Convergence If signal xit) is piecewise smooth in each finite interval and is, 
in addition, absolutely integrable, i.e., it satisfies the inequality 



|jc(0| dt < K < oo 


(2.43) 


where K is some positive constant, then the integral in Eq. (2.27) converges. Furthermore, 
the substitution of X(ju>) in Eq. (2.29) converges to x(t) at points where x(t) is continuous; 
at points where xit) is discontinuous, Eq. (2.29) converges to the average of the left- and 
right-hand limits of x(t ), namely, 


x(t) — l[x(f+) + x(f-)] 


Proof (See pp. 471-473 of [6] for proof.) ▲ 

The convergence theorem essentially delineates sufficient conditions for the existence of the 
Fourier transform and its inverse and is analogous to the convergence theorem of the Fourier series, 
i.e., Theorem 2.1. Note that periodic signals are not absolutely integrable as the area under the graph 
of |x(f)| over the infinite range —oo < t < oo is infinite, and a similar problem arises in connection 
with impulse signals which comprise infinitely tall and infinitesimally thin pulses. The application 
of the Fourier transform to signals that do not satisfy the convergence theorem will be examined in 
Sec. 6.2. 

The following theorems hold if x(t), X\(t), and X 2 (t) are absolutely integrable, which would 
imply that 


x(t) X(jbo) xft) Xfijco) x 2 (t) X 2 (jco) 

The parameters a , b, to, and a> o are arbitrary constants which could be complex in theory. 

Theorem 2.6 Linearity The Fourier transform and its inverse are linear operations, that 
is, 

axfit) + bx 2 (t) <-► aXiijus) + bX 2 (juo) 


Proof See Prob. 2.18. A 
Theorem 2.7 Symmetry 10 

the Fourier transform pair 

can be generated. 


Given a Fourier transform pair 
x(t) <-+ X(joo) 

X(jt) 2tvx(—u}) 


10 Also referred to as the duality property. 
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Proof By letting t —> — t in the inverse Fourier transform of Eq. (2.29), we get 

/ oo 

X(jco)e~ j ‘clco 

-OO 

and if we now let t cd and to —> t, we have 

poo 

2nx{—co) = / X{jt)e~ ja ' dt 


that is, the Fourier transform ofX(jt) is 2 Jtx(-co) and the inverse Fourier transform of2nx(—to) 
is X(jt). A 

Theorem 2.8 Time Scaling 


1 f juj 
x{at) *->■ -—-X — 

M V « 

Proof Assuming that a > 0, letting t = t'/a, and then replacing t' by t in the definition of the 
Fourier transform, we get 


/ OO 1 pOO 

x(at)e~ ja) ' dt = / x(t')e-i {u, l a)t dt' 

oo & J — oo 

= - / x(t) e - Ko,/a) ‘ dt 

a J —oo 

1 / co\ 

= -x(j-) 

a V a J 


(2.44a) 


If a < 0, proceeding as above and noting that the limits of integration are reversed in this case, 
we get 


I x(at)e ■’ rM dt = — I x(t')e ^ t ' 

1 —oo ® Joo 


I f 00 

-/ x{t)e- j(0>la)t dt 

a J- oo 



(2.44b) 


Now, if we compare Eqs. (2.44a) and (2.44b), we note that Eq. (2.44b) applies for a < 0 as well 
as for a > 0, and hence the theorem is proved. A 

One often needs to normalize the time scale of a signal to a more convenient range to avoid 
awkward numbers in the representation. For example, the time scale of a signal that extends from 0 
to 10 6 s could be scaled to the range 0 to 1 s. Occasionally, the available signal is in terms of a 
normalized time scale and it may become necessary to ‘denormalize’ the time scale, say, from the 
normalized range 0 to 1 s to the actual range. In either of these situations, time scaling is required, 
which changes the Fourier transform of the signal. 
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Theorem 2.9 Time Shifting 

x(t - t 0 ) <-► e~ JU}t °X(juj ) 

Proof See Prob. 2.19, part (a). A 

The time-shifting theorem is handy in situations where a signal is delayed or advanced by 
a certain period of time. Evidently, delaying a signal by to s amounts to multiplying the Fourier 
transform of the signal by the exponential of —jcoto- 

Theorem 2.10 Frequency Shifting 

e juot x(t) X(juj - juj {) ) 

Proof See Prob. 2.19, part ( b ). A 

The similarity of Theorems 2.9 and 2.10 is a consequence of the similarity between the Fourier 
transform and its inverse. 


Theorem 2.11 Time Differentiation 

d k x(t) . 

—^^ (ju:) k X(juj) 

Proof The theorem can be proved by obtaining the kth derivative of both sides in Eq. (2.29) 
with respect to t. A 


Theorem 2.12 Frequency Differentiation 


(- jt) k x(t) 


d k X(ju>) 

duj k 


Proof The theorem can be proved by obtaining the A'th derivative of both sides in Eq. (2.27) 
with respect to co. A 


Theorem 2.13 Moments Theorem For a bounded signal x(t ), the relation 


{-j) k m k 


rf A Z(0) 

du> k 


(2.45) 


holds where 


m k 

is said to be the kth moment of x(t ). 



t k x(t)dt 


Proof See Ref. [5] for proof. A 

The moments theorem will be found useful in the derivation of Fourier transforms for Gaussian 
functions (see Example 2.11). 
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Theorem 2.14 Time Convolution 

xi(t) ® x 2 (t) <-► X i (ju})X 2 (juj) 

where 


Xi(t) ® x 2 {t ) 


' — OO 
pOO 


xi(T)x 2 (t — r)dr 
Xi (/ — t)x2(t)cIt 


(2.46a) 

(2.46b) 


Proof From Eq. (2.46b) and the definition of the Fourier transform, we have 


/ oo r poo 
-oo L J —oo 

/ OO POO 

/ xft — x)x 2 (x)e~-' wt dxdt 

-oo J—oo 

As x\(t) and x 2 (t) are deemed to be absolutely integrable, they are bounded and hence the order 
of integration can be reversed. We can thus write 


F[x\{t) <g> X 2 (?)] = 


xi(t — r)x 2 (x) dr 


- jrot dt 


poo poo 


T\x\(t) ® x 2 {t)} = 


1—00 J—oo 


x\{t — r)x 2 (r)e }mt dtdr 

) 

/ OO POO 

x 2 (x)e~^ a,T / X\{t — r)e~-' lo< ' , ~ T ^ dtdr 
-oo J —oo 

By applying the variable substitution t = t’ + r and then replacing t’ by t, we get 

/ oo r poo 

x 2 {r)e~ imT / xi(t')e~ ju>1 ' dt' 

-oo L J —oo 

/ oo r poo 

x 2 (r)e~ jloz / xi(t)e~-’ 0>t dt 

-oo \_J —OO 

poo 

= / x 2 {r)e~ i<ox X\{jco)dx 


d x 

dx 


and as Xi(jco) is independent of r, we can write 


T[xi (?) ® x 2 (t)] = Xi 



x 2 (x)e ja>T dx 


= X,(joj)X 2 (joj) 


The same result can be obtained by starting with Eq. (2.46a) (see Prob. 2.21). ▲ 

The above theorem is stating, in effect, that the Fourier transform of the time convolution is 
equal to the product of the Fourier transforms of the two signals. Equivalently, the time convolution 
is equal to the inverse Fourier transform of the product of the Fourier transforms of the two signals. 
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Therefore, if a Fourier transform X(jco) can be factorized into two Fourier transforms X\(jco) and 
X 2 (,/&>), that is, 

X(jco) = X t (joj)X 2 (joj) 

whose inverse Fourier transforms x\(t) and X 2 (f) are known, then the inverse Fourier transform of 
the product X(jco) can be deduced by evaluating the time convolution. 


Theorem 2.15 Frequency Convolution 

1 

x x (t)x 2 (t) <-»■ —Xxijuj) ® X 2 (juj) 


where 


Xi{jus) ® X 2 ( juj) 


X, (jv)X 2 ( ju3 - jv)dv 

i 

XiijuJ - jv)X 2 (jv)dv 


(2.47a) 

(2.47b) 


Proof The proof of this theorem would entail using the definition of the inverse Fourier trans¬ 
form and then reversing the order of integration as in the proof of Theorem 2.14. The second 
formula can be obtained from the first through a simple change of variable. (See Prob. 2.22, 
part (b).) A 


Theorem 2.16 Parseval’s Formula for Nonperiodic Signals 

1 

x{t)\ 2 dt = — \X(ju>)\ 2 duj 

2tt J _ 0 o 

Proof From Theorem 2.15, 



x\(t)x 2 (t)e i wt dt = 


2n 


Xi(jv)X 2 (jco- jv)dv 


By letting a> —> 0, then replacing v by u>, we have 

1 


/ xi (t)x 2 (t)dt = 
l—oo J —q 


X\{j(d)X 2 {—j(d) dco 


Now if we assume that vi(f) = x(t ) and x 2 (t) = x*(t), then X 2 (—ja >) = X*(ja>) (see 
Prob. 2.23, part ( b )). Hence, from the above equation, we obtain 


x(t)x*(t) dt = 


1 

2 :r 


X(ja>)X*(ja>)dco 


or 



|x(f)| 2 dt 


1 r°° 

— / \X(jca)\ 2 dm A 

J —OO 
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If x(t) represents a voltage or current waveform, the left-hand integral represents the total 
energy that would be delivered to a l-f2 resistor, that is, 

1 r°° 

E t = — \X(jco)\ 2 dco (2.48) 

J —oo 

and if co = 2:xf then the energy of the signal over a bandwidth of 1 Hz, say, with respect to the 
frequency range 

< f < h+\ 

can be obtained from Eq. (2.48) as 

i r (fo+ b 

A E t = — \X(jco)\ 2 

2 ” J-ifi-j) 

r(fo+ y) 

« |A(> 0 )| 2 / . df= \X(jtoo)\ 2 

J-U0-5) 

In effect, the quantity \X(jco)\ 2 represents the energy density per unit bandwidth (in Hz) of the signal 
at frequency / = o)/2tc (in Hz) and is often referred to as the energy spectral density. As a function 
of co, \X(joj)\ 2 is called the energy spectrum of x(t). 

Parseval’s formula is the basic tool in obtaining a frequency-domain representation for random 
signals, as will be shown in Chap. 13. 

The application of the above theorems is illustrated through the following examples. 


Example 2.7 


Show that 


where 


sin zwt/2 

-** p m (co) 

nt 


Pm(C0) 


for \oo\ < nr/2 
otherwise 


■ Solution 


From Example 2.5, we have 

2 sin cor /2 
Pr(t) - 

CO 


where 


Pxit) = 



for |f| < r/2 
otherwise 
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By using the symmetry theorem (Theorem 2.7), we get 


2 sin rt /2 
t 


-O' 27tp T ( — a>) 


where 


pA-w) 



for | — a>\ < r/2 
otherwise 

for M < r/2 
otherwise 


= Pz(a>) 


Now if we let r = ru, we get 

sin nrf/2 

- ** p m (a >) ■ 

TCt 


where 


Pm(co) 



for \u>\ < uj /2 
otherwise 


Example 2.8 


Obtain the Fourier transform of the signal shown in Fig. 2.9 a. 


■ Solution 


From Fig. 2.9 a, the given signal can be modeled as 

x{t ) = Pz /2 (t + \z) - p T /i ( t - \t) (2.49) 

by using shifted copies of the pulse p z / 2 (t) which is obtained by replacing r by r/2 in 
the pulse of Example 2.5. 

On using the linearity and time-shifting theorems, we get 
X(ju) = T \p z/2 (t + \t) - p t (t - \r)] 

= FPt/ 2 (t + \r) ~ FPt/ 2 (t ~ \r) 

= e jmlA T Pzl 2 (t) - e- j<ot/4 ^p z/ 2 (t) 

and from Example 2.5, we deduce 


X(jw) = (e' 011/4 - e- jwr/4 )Fp z/2 (t) = 4j Sm Wt/4 


(2.50) 


Hence 


Pz/2 {t+\x) - p z/ 2 


j . 4 j sin 2 air/4 











Magnitude 
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for u> > 0 
for u> < 0 

(See Fig. 2.9 b and c for plots.) 

1.5 

1.0 

0.5 

§ 0 

- 0.5 

- 1.0 

- 1.5 

- 2-10 1 2 
Time, s 
(a) 


Time domain 




Amplitude spectrum Phase spectrum 




Frequency, rad/s Frequency, rad/s 

(b) (c) 

Figure 2.9 Frequency spectrum of the function in Eq. (2.49) (Example 2.8 with a = 0.4): 
(a) Time-domain representation, (b) amplitude spectrum, (c) phase spectrum. 
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Example 2.9 


Obtain the Fourier transform of the triangular pulse q T (t) shown in Fig. 2.10 a. 


> Solution 

From Fig. 2.10a, we have 


Qx(t) = 


1 _ M 

10 ’ 


for \t\ < r/2 
for |f| > r/2 


We note that the given triangular pulse can be generated by performing the integration 

r ‘ 2 x(t) 


qAt) = 


dt 


(2.51) 


where 

X(t) = Pr/2 (t + \x) ~ Pz /2 (t - \t) 

(see Example 2.8). If we differentiate both sides in Eq. (2.51), we get 

dq z (t) 2 x(f) 
dt x 


(2.52a) 


If we apply the time-differentiation theorem (Theorem 2.11) with k — 1 to the left-hand 
side of Eq. (2.52a), we have 


T 


dqAt) 

dt 


= juQAjv) 


(2.52b) 


On the other hand, if we apply the Fourier transform to the right-hand side of Eq. (2.52a), 
we get 


2 x(t) 


T 

Therefore, from Eqs. (2.52a)-(2.52c) 

’ dqAt) 


2 X(Ja>) 


(2.52c) 


T 


dt 


= T 


2 x(t) 


QAjco) = 


2 Xjjco) 

jot X 


and from Eq. (2.50), we get 


QAjot) 


S shr wr/4 























Magnitude 
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or 

8 siir a>r/4 

qz(t) t - ■ 

<y 2 r 

The amplitude spectrum is illustrated in Fig. 2.10 b. The phase spectrum is zero for 
all frequencies since the signal is areal, even function of time (see Eqs. (2.36a) and (2.36b)). 


Time domain 



Time, s 
(a) 

Amplitude spectrum 



Figure 2.10 Frequency spectrum of triangular function (Example 2.9 with r = 1.0): 
(a) Time-domain representation, ( b ) amplitude spectrum. 
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Example 2.10 


Obtain the Fourier transform of the decaying sinusoidal signal 
x(t) = u(t)e~ a> sina>o t 


(see Fig. 2.1 In) where a and co o are positive constants. 


i Solution 

We can write 


x(t ) = u(t)e sincuof = —— (e ja>0 ‘ — e jo>ot ) e 

2 j 

_ U ^ („-(<*-jio 0 )t _ e ~(a+jioo)t\ 

' V 1 ’ 


J“>ot _ a -at 


From Example 2.6, we have 


u(t)e at -o- 


1 


a + jco 

and if we replace a first by a — jco and then by a + jco, we get 

1 


u(t)e 




a - jco 0 + jco 


and 


u(t)e 


-(a+ja>o)t 


1 


<r> 


a + jcoQ + jco 


respectively. Now from Eqs. (2.53a)-(2.53c) 


u(t) 


(a-j(o 0 )t _ -(u+jco 0 )t\ 


— e 


2 j 


1 


1 


a — jco o + jco a + jcoo + jco 


or 


u(t)e at sin&io? ** 


coo 


co o 


a 2 + ojg — co 2 + j2aco (a + jco) 2 + u> q 

Hence, the amplitude and phase spectrums of the decaying sinusoidal 


(2.53a) 


(2.53b) 


(2.53c) 
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signal are given by 


A(©) = 


®o 


and 


\J (a 2 + (Wq — a> 2 ) 2 + 4a 2 a> 2 

2q!(W 

<K«) = - tan —2- - 

a z + a>n — a> z 


respectively. (See Fig. 2.11 b and c for the plots.) 

Time domain 



Figure 2.11 Frequency spectrum of continuous-time decaying sinusoidal signal (Example 
2.10, a — 0.4, a>o = 2.0): (a) Time-domain representation, ( b) amplitude spectrum, (c) phase 
spectrum. 
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Example 2.11 


Fig. 2.12a). 


Obtain the Fourier transform of the Gaussian function xit) = e 0,1 


(see 


■ Solution 

A solution for this example found in Ref. [5] starts with the standard integral 

e~ a ' 2 dt = 

which can be obtained from mathematical handbooks, for example, Ref. [7]. On dif¬ 
ferentiating both sides of this equation k times with respect to a, we can show that 





(2.54a) 


On the other hand, if we replace e ' mt by its series representation (see Eq. A. 1 la) in the 
definition of the Fourier transform, we get 


X(ju) = 




OO 


E 


(-jut? 

k\ 


dt 


OO 


= E 


(-ju? 

k\ 



OO 


E 


(~jo>? 

k\ 


m k 


(2.54b) 


where 



is the kth moment of x(t) (see Theorem 2.13). As x(t) is an even function, the moments 
for odd k are zero and hence Eq. (2.54b) can be expressed as 


w • , , (~ju ) 2 , (-jot? 

X(ja>) = m 0 H-—— m 2 H-—— m 4 

^ i-jco) 2k 

= 2 ^ m 2k 


k=0 


(2k)! 


m 2 k 



■ (2k - 1 ) i~ir~ 
~2 k V a 2k+l 


where 



















Magnitude 
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Time domain 



Time, s 

(a) 



-5 0 5 

Frequency, rad/s 

(b) 

Figure 2.12 Frequency spectrum of continuous-time Gaussian function: (Example 2.11, 
a = 1.0): (a) Time-domain representation, ( b ) amplitude spectrum. 


according to Eq. (2.54a) or 


X(jco) = J2 


(~J0J) 2k 1 • 3 ■ ■ ■ (2k — 1) 


k =0 


( 2 *)! 


2 k 


JT 


,2k+l 


E 

k=0 


1 • 3 ■ ■ • (2 k- 1 )(-jco) 


2k 


(2k)\(2a) k 
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The summation in the above equation is actually the series of e " 2 / 4 “, as can be readily 
verified and, therefore, 


X(jca) = i /^ e -“ 2 / 4 “ 
V a 


or 


e 


-at 2 





The Gaussian function and its Fourier transform are plotted in Fig. 2.12 and as can 
be seen, the frequency-domain function has the same general form as the time-domain 
function. (See Eq. (6.26) for another transform pair that has this property.) 


The Fourier transform pairs obtained in this chapter are summarized in Table 2.1. We have not 
dealt with impulse functions or periodic signals so far because these types of signals require special 
attention. It turns out that the applicability of the Fourier transform to periodic signals relies critically 
on the definition of impulse functions. Impulse functions and periodic signals are, of course, very 
important in DSP and they will be examined in detail in Chap. 6. 


Table 2.1 Standard Fourier transforms 
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PROBLEMS 

2.1. Derive Eq. (2.4). 

2.2. Derive Eqs. (2.12c) and (2.12d). 

2.3. A periodic signal xft) is described by Eq. (2.1) with 



(a) Obtain the Fourier series of x(t) in the form of Eq. (2.3). 

( b ) Express the Fourier series in the form of Eq. (2.9). 

(c) Express the Fourier series in the form of Eq. (2.13b). 

(d) Obtain the amplitude and phase spectrums of x(t). 

2.4. A periodic signal x(t) is described by Eq. (2.1) with 


0 for — t 0 /2 < t < — 3r 0 /8 


1 for — 3t 0 /8 < t < — To/4 
x(t) = < 2 for — t 0 /4 < t < t 0 /4 


1 for t 0 /4 <t< 3t 0 /8 
0 for 3 t 0 /8 < t < tq/2 


(a) Obtain the Fourier series of x(t ) in the form of Eq. (2.3). 

( b ) Express the Fourier series in the form of Eq. (2.9). 

(c) Express the Fourier series in the form of Eq. (2.13b). 

{d) Obtain the amplitude and phase spectrums of x(t). 

2.5. A periodic signal x(t) is described by Eq. (2.1) with 



where r < To¬ 
la) Obtain the Fourier series of x(t) in the form of Eq. (2.3). 

( b ) Express the Fourier series in the form of Eq. (2.9). 

(c) Express the Fourier series in the form of Eq. (2.13b). 

(. d ) Obtain the amplitude and phase spectrums of x(t). 
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2.6. A periodic signal x(t) is described by Eq. (2.1) with 


x(t) = 



for — To/2 < t < — t/2 
for — t/2 < t < t/2 
for t/2 < t < tq/2 


where t < r 0 . 

(a) Obtain the Fourier series of x(t) in the form of Eq. (2.3). 
(£>) Express the Fourier series in the form of Eq. (2.9). 

(c) Express the Fourier series in the form of Eq. (2.13b). 

(. d ) Obtain the amplitude and phase spectrums of x(t). 

2.7. A periodic signal x(t) is described by Eq. (2.1) with 


x(t) = 


for —t 0 /2 < t < —t 2 
for —t 2 < t < —Tl 
for —Ti < t < T\ 
for Tl < t < t 2 
for t 2 < t < t 0 /2 


where Ti < t 2 < t 0 /2. 

(a) Obtain the Fourier series in the form of Eq. (2.3). 

( b ) Obtain the amplitude and phase spectrums of x (t). 

2.8. A periodic signal x(t) is described by Eq. (2.1) with 


x(t) = 



for — To/2 < t < — t 2 
for —t 2 <t< —Ti 
for —Ti < t < Ti 
for Ti < t < t 2 
for t 2 < t < t 0 /2 


where Ti < r 2 < t 0 /2. 

(a) Obtain the Fourier series in the form of Eq. (2.3). 

(b) Obtain the amplitude and phase spectrums of x(t). 

2.9. A periodic signal x(t) is described by Eq. (2.1) with 


x(t) = 


0 

1 


for — t 0 /2 < t < — t 2 
for —t 2 < t < —Ti 
for — Ti < t < T] 
for Ti < t < t 2 
for t 2 < t < Tq/2 


where T t < t 2 < t 0 /2. 

(a) Obtain the Fourier series in the form of Eq. (2.3). 

(b ) Obtain the amplitude and phase spectrums of x{t). 

2.10. A periodic signal is given by 


x(t) = cos 2 cot + cos 4 a>t 

(a) Obtain the Fourier series of x(t ) in the form of a linear combination of cosines. 

(b) Obtain the amplitude and phase spectrums of x(t). 
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2 . 11 . A periodic signal is given by 


x(t) = ' + sin cot + i sin 2 cot + cos 4 cot 


(a) Obtain the Fourier series of ic(t ) in the form of a linear combination of sines. 

(b) Obtain the amplitude and phase spectrums of x(t). 


2 . 12 . 


Find the Fourier series 
(a) x(t) = at for 


(b) x(t) = 


—at 

at 


of 

— t 0 /2 < t < t/2 
for — to/2 < t < 0 
for 0 < t < tq/2 


2 . 13 . Find the Fourier series of 

for — t 0 /2 < t < r 0 /2 

for — to/ 2 < i < 0 
for 0 < t < to/2 

2 . 14 . Find the Fourier series of 

(а) x(t) = jt for - r 0 /2 < |f| < r 0 /2 

(б) x(f) = j\t\ for - t 0 /2 < |r| < r 0 /2 


(a) x(t) = | costt) 0 f| 
where a> 0 = 2n/x 0 . 

(b) x(t) = < ^ . 

|| sincuofl 

where too = 2n /zq. 


2 . 15 . Find the Fourier series of 

(a) x(t) = f/fo + 1/2 for — z 0 /2 < t < r 0 /2 


(b) x(t) = 


0 

c"o f 

e - “o' 


0 


for — to/2 < I < — to/4 
for — to/4 < t < 0 
for 0 < t < r 0 /4 
for r 0 /4 < t < t 0 /2 


2 . 16 . Assuming that a:(?) is a real signal which can be either an even or odd function of time, show that 

(a) X(-/«) = -X*(jco) 

(b) \X(—jco)\ = \X(jaj)\ 

(c) arg X(—jco) = - arg Afy'ftj) 

2 . 17 . Assuming that x(t) is purely imaginary show that 
(a) 


/ OO 

3m x(t) sin cot dt and 

•OO 


/ OO 

91e;t(f)cos cot dt 

-OO 


(&) Assuming that x(t) is purely imaginary and an even function of time, show that 2t\e X(jco) is an odd 
function and 3m X(jco) is an even function of frequency. 

(c) Assuming that x(t) is purely imaginary and an odd function of time, show that Die X(jco) is an even 
function and 3m X(jco) is an odd function of frequency. 

2 . 18 . (a) Prove Theorem 2.6 (linearity) for the Fourier transform. 

(b) Repeat part (a) for the inverse Fourier transform. 

2 . 19 . (a) Prove Theorem 2.9 (time shifting). 

(, b ) Prove Theorem 2.10 (frequency shifting). 
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2.20. Show that 



Xi(r)x 2 (t — t) dr = / *i(f — t)x 2 (t) dr 


—oo J — oo 


2.21. Prove Theorem 2.14 (time convolution) starting with Eq. (2.46a). 

2.22. (a) Prove Theorem 2.15 (frequency convolution) starting with Eq. (2.47a). 

(.b) Show that Eq. (2.47b) is equivalent to Eq. (2.47a). 

2.23. A complex signal *2(0 is equal to the complex conjugate of signal x(f). Show that 

(a) XUa>) = X*(-jw) 

(b) X(-jco ) = X*(joj) 

2.24. (a) Find the Fourier transform of x(t) = p z (t — r/2) where p z (t) is a pulse of unity amplitude and 

width r. 

(b) Find the Fourier transform of 



1 for — t 0 /2 <t< — t 0 /4 

2 for — r 0 /4 <t< r 0 /4 

1 for to/4 <t< ro/2 

0 otherwise 


(c) Find the amplitude and phase spectrums for the signal in part (b). 

2.25. (a) Find the Fourier transform of 


*j(f) = [u(t + r/2) — u(t — r/2)] 


where u(t) is the continuous-time unit-step function defined as 



for t > 0 
for t < 0 


(b) Sketch the waveform of 


OO 



(c) Using the result in part (a), find the Fourier transform of * 2 (0- 

2.26. Find the Fourier transform of x{t) = u(t — 4.5T) — u(t — 9.5T). 


(b) Obtain the amplitude and phase spectrums of x(t). 

2.27. (a) Find the Fourier transform of 



where o> 0 = 2jr/r 0 . 

(b ) Obtain the amplitude and phase spectrums of x(t). 


2.28. (a) Find the Fourier transform of x(t) = u(t)e cosa> 0 f • 
(b ) Obtain the amplitude and phase spectrums of x(t). 
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2.29. (a) Find the Fourier transform of 


x{t) = 


e at cosh a> 0 t 

0 


for 0 < t < 1 
otherwise 


(b) Obtain the amplitude and phase spectrums of x(t). 
(See Prob. 2.25 for the definition of u(t).) 


2.30. (a) Find the Fourier transform of 

x(t) = 


sinft) 0 f for — To/4 < t < r 0 /4 

0 otherwise 


where cu 0 = 2tz/z 0 

(b) Obtain the amplitude and phase spectrums of x(t). 

2.31. (a) Find the Fourier transform of 


x(t) = 


e at sinh co 0 t for — 1 < t < 1 
0 otherwise 


(b) Obtain the amplitude and phase spectrums of x(t). 

2.32. Find the Fourier transforms of 


[ cosa>ot| 
0 


(a) x(t ) = 
where a> 0 = 2n/z 0 

(b) x(t) = 


for — to/2 < t < to/2 
otherwise 


| sincu 0 t| 

[0 

where a> 0 = 2n/z 0 
2.33. Find the Fourier transforms of 


for 0 < t < z 0 /2 
otherwise 


1 

(a) x(t) = < 1 
0 


for — z 2 < t < — Ti 
for Ti < t < Z 2 
otherwise 


where ti and Z 2 are positive constants and zi < Z 2 


■ e “'° f for — to/4 <t<0 

(,b ) jc(?) = i e - " 0 ' for 0 < t < z a /A 
I 0 otherwise 


2.34. (a) Using integration by parts, show that 

ate^' dt = a(/l? — l)e^‘/fi 2 

(b) Using the result in part (a) find the Fourier transform of 


/< 


x(t ) = 

(c) Find the Fourier transform of 

x(t) = 


at for —to/2 < t < z /2 

0 otherwise 


for —z 0 /2 < t < 0 
for 0 <t< r 0 /2 
otherwise 
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2.35. Find the Fourier transforms of 


(a) x(t) = 


(a) x(t) = 


(b) x(t) = 


f/r 0 + 1/2 for —t 0 /2 < t < 

0 

otherwise 

'1 + ? 

for r 0 /2 < f < 0 

1 - t 

for 0 < t < t 0 /2 

0 

otherwise 

rier transforms of 

jt 

for —r 0 /2 < |f| < r 0 /2 

0 

otherwise 

j\A 

for —t 0 /2 < [r| < t 0 /2 

0 

otherwise 


2.37. Obtain the Fourier transforms of the following: 
(a) x(t) = e~°“ cos 2 a> 0 t 


where a > 0 
C b ) x(t) = cos at 2 


CHAPTER 

3 


THEZ 

TRANSFORM 


3.1 INTRODUCTION 

Chapter 2 has dealt with the Fourier series and transform. It has shown that through these mathematical 
tools, spectral representations can be obtained for a given periodic or nonperiodic continuous-time 
signal in terms of a frequency spectrum, which is composed of the amplitude and phase spectrums. 
Analogous spectral representations are also possible for discrete-time signals. The counterpart of the 
Fourier transform for discrete-time signals is the z transform [1]. The Fourier transform will convert 
a real continuous-time signal into a function of complex variable jco. Similarly, the z transform will 
convert a real discrete-time signal into a function of a complex variable z. The transform name is 
based on nothing more profound than the consistent use of the letter z for the complex variable 
involved over the years. 

The z transform, like the Fourier transform, comes along with an inverse transform, namely, 
the inverse z transform. As a consequence, a signal can be readily recovered from its z transform. The 
availability of an inverse makes the z transform very useful for the representation of digital filters 
and discrete-time systems in general. Though the most basic representation of discrete-time systems 
is in terms of difference equations, as will be shown in Chap. 4, through the use of the z transform 
difference equations can be reduced to algebraic equations which are much easier to handle. 

In this chapter, the z transform is first defined as an independent mathematical entity and it is 
immediately shown that it is actually a particular type of Laurent series. The inverse z transform is 
then introduced as a means of recovering the discrete-time signal from its z transform. This turns out 
to be an exercise in constructing Laurent series. The properties of the z transform are then described 
through a number of fundamental theorems as was done for the Fourier transform in Chap. 2. The z 
transform is then used for the representation of some typical discrete-time signals. 
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The chapter concludes with the application of the z transform as a tool for the spectral rep¬ 
resentation of discrete-time signals. The application of the z transform for the representation of 
digital filters and discrete-time systems in general will be treated in Chap. 5 and certain fundamental 
interrelations between the z transform and the Fourier transform will be investigated in Chap. 6. 


3.2 DEFINITION OF Z TRANSFORM 

Given an arbitrary discrete-time signal that satisfies the conditions 


(i) 

x(nT) = 0 

for n < — A'| 

(ii) 

\x(nT)\ < K { 

for — N i < n < N 2 

(iii) 

\x(nT)\ < K 2 r n 

for n > N 2 


where N i, AA are positive integers and K\, AS, and r are positive constants, the infinite series 

OO 

X(z) = x{nT)z~" (3.1) 

n=—oo 


can be constructed where z is a complex variable. In mathematical terms, this is a Laurent series (see 
Sec. A.6) but in the digital signal processing (DSP) literature it is referred to as the z transform of 
x(nT). As will be shown in Sec. 3.4, this turns out to be a unique representation of x(nT) for all the 
values of z for which it converges. 

Infinite series are not convenient to work with in practice but for most well- behaved discrete¬ 
time signals that can be represented in terms of analytical expressions, the z transform can be 
expressed as a rational function of z of the form 


X(z,) = 


N{z) 

D(z) 


Z N + Ell biZ N 


(3.2a) 


By factorizing the numerator and denominator polynomials, namely, N(z ) and D(z), X(~) can be 
put in the form 


X(z) = 


N (z ) _ UfLliz - Zi ) 

°n Uz- Pi ) 


(3.2b) 


where Zi and p, are the zeros and poles of X(z). Thus the z transform of a discrete-time signal can 
be represented by a zero-pole plot. For example, the z transform 


X(z) = 


(■z 2 - 4) 

z(z 2 — 1 )(z 2 + 4) 


(z - 2)(z + 2) 

z(z - 1)(Z + l)(z - j2)(z + j 2) 


(3.3) 


can be represented by the zero-pole plot shown in Fig. 3.1. 
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j3mz 

ft 


-2 -1 


-fl :< 


z plane 


-X-O- 

1 2 ^ 


Figure 3.1 Zero-pole plot of z transform X(z) in Eq. (3.3). 


3.3 CONVERGENCE PROPERTIES 

The infinite series in Eq. (3.1) is meaningful if it converges and, as in the case of the Fourier transform, 
convergence theorems exist that specify the circumstances under which the series converges. Two 
such theorems pertaining to absolute and uniform convergence are examined next. An infinite series 
is said to converge absolutely if the sum of the magnitudes of its terms has a finite value. An infinite 
series that involves an independent complex variable is said to converge uniformly in a given region 
of convergence if it converges absolutely everywhere in that region. 

Theorem 3.1 Absolute Convergence If 


(i) 

x(nT ) = 0 

for n < — Ni 

(ii) 

|x(hD| < Ki 

for — Ni < n < N 2 

(Hi) 

|jc(hD| < K 2 r n 

for n > N 2 


where N i and N 2 are positive constants and r is the smallest positive constant that will satisfy 
condition (Hi), then the z transform as defined in Eq. (3.1) exists and converges absolutely 
(see Theorem A.2) if and only if 

r < |z| < R 0 o with Roo —» 00 (3.4) 

Proof If we let z = pe ,r ' ■ we can write 

OO OO 

Y, I x(nT)z~ n \= Y ■ \z~"\ 

n= — 00 n= — 00 

OO 

= 51 \x(nT)\.\p~ n e^\ 

n= — 00 
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Noting that the magnitude of p n e^"° is simply p " (see Eq. (A.13b)) and then substituting 
conditions (i) to (iii) of the theorem in the above equation, we get 

OO 

5 ] \x(nT)z ~ n | < 

n =—oo 

< 

The first term at the right-hand side is the sum of a finite number of negative powers of p and 
since p is implicitly assumed to be finite, the first term is finite. The second term is the sum 
of a geometric series and if p > r, that is, r /p < 1, it is finite by virtue of the ratio test (see 
Theorem A.3). Hence 


N 2 — 1 OO / \ 

n=—Ni n—N 2 7 


n=—N] 
N 2 -1 


* E p~ n + ^ E - 


n=—N 1 


n—N 2 


(3.5) 


OO 

5] \x(nT)z~ n \ < K 0 

Yl ——OO 

where is finite, i.e., X(z) converges absolutely. If p < r, then r/p > 1 and ( r/p) n — > oo as 
n —*■ oo; consequently, the right-hand summation in Eq. (3.5) becomes infinite. If p = r, then 
(r/p) 11 = 1 for all n. However, the right-hand summation in Eq. (3.5) entails an infinite number 
of ones and again it is infinite. In effect, X(z) converges absolutely if/) > r and diverges if p < r. 

There is one more situation that needs to be taken into account before the proof can be 
considered complete, namely, the behavior of X(z) as z -> oo. If x(nT) / 0 for one or more 
negative values of n, then 


OO 

lim x(nT)z~" —> oo 

z—>oo ' 

n= —oo 

That is, X(z) diverges if z — oo and, therefore, it converges if and only if 

r < |z| < oo or r <\z\ < Roo with Roo —*■ oo 

In terms of the usual mathematical language, this is the necessary and sufficient condition for 
absolute convergence. A 

Summarizing the essence of the above theorem, if x(nT) is bounded by the shaded region in 
Fig. 3.2 a, then its z transform converges absolutely if and only if z is located in the shaded region of 
the z plane depicted in Fig. 3.2 b where R^_ -> oo. The area between the two circles is referred to as 
an annulus and the radius of the inner circle, namely, r, as the radius of convergence of the function 
since the inner circle separates the regions of convergence and divergence (see Sec. A.5). 

Theorem 3.2 Uniform Convergence X(z) converges uniformly and is analytic in the region 
defined by Eq. (3.4). A 

This theorem follows readily from Theorem 3.1. Since X(z) converges absolutely at any point 
in the region defined by Eq. (3.4), it has a limit and a derivative at any point in the region of 
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Figure 3.2 Convergence of z transform: (a) Bounds in time domain, ( b) region of convergence in z domain. 


convergence. Therefore, X(z ) is analytic in the annulus of Eq. (3.4). In addition, X(z) converges 
uniformly in that annulus, which is a way of saying that the convergence X(z) is independent of z 
(see Sec. A.5). 


3.4 THE Z TRANSFORM AS A LAURENT SERIES 

If we compare the series in Eq. (3.1) with the Laurent series in Eq. (A.49), we note that the z transform 
is a Laurent series with 


X(z)=F(z) x(nT) = a n a = 0 

Therefore, the z transform inherits properties (a) to (d) in Theorem A.4. 

From property (a), if X(z), for example, the function represented by the zero-pole plot in 
Fig. 3.3fl is analytic on two concentric circles C\ and C 2 with center at the origin and in the area 
between them as depicted in Fig. 3.3 b, then it can be represented by a series of the type shown in 
Eq. (3.1) where x(nT) is given by the contour integral 

x(nT) = </ X(z)z n ~ 1 dz (3.6) 

2jr; J r 

The contour of integration T is a closed contour in the counterclockwise sense enclosing all the 
singularities of X(z) inside the inner circle, i.e., C 1 . 

From property ( b ), a Laurent series of X(z) converges and represents X(z) in the open annulus 
obtained by continuously increasing the radius of C 2 and decreasing the radius of C\ until each of 
C 2 and Ci reaches one or more singularities of X(z), as shown in Fig. 3.3c. 
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Figure 3.3 Laurent series of X(z) with center at the origin of the z plane: (a) Zero-pole plot of X(z), ( b ), 
(c), and ( d ) Properties (a), ( b ), and ( c), respectively, of the Laurent series (see Theorem A.4). 


From property (c), X(z) can have several, possibly many, annuli of convergence about 
the origin; and from property ( d ), the Laurent series for a given annulus of convergence is 
unique. For example, function X(z ) given by Eq. (3.3) has three distinct annuli of convergence, 
namely, 


A\ = {z : Rq < |z| < 1} 
An = [z : 1 < |z| < 2} 
A m = {z : 2 < |z| < R^} 


as illustrated in Fig. 3.3 d where Rq -> 0 and -> oo, and a unique Laurent series can be obtained 
for each one of them. 
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3.5 INVERSE Z TRANSFORM 

According to Theorem 3.1, the z. transform of a discrete-time signal is a series that converges in the 
annulus defined by Eq. (3.4), that is. 


r < |z| < Roc with Roc —»■ oo 


where r is specified in condition (iii) of the theorem. On the other hand, the Laurent theorem states 
that function X(z) can have several Laurent series, possibly many, about the origin that converge in 
different annuli but each one is unique to its annulus of convergence. 

The only annulus of convergence that is consistent with the annulus in Eq. (3.4) is the outermost 
annulus of X(z), which is defined as 


R < |z| < Roo with Roc —> oo 


(3.7) 


where R is the radius of a circle passing through the most distant singularity of X(z) from the origin. 
Therefore, we must have r — R, that is, if the pole locations of X(z ) are known, the template that 
bounds the discrete-time signal in Fig. 3.2 a can be constructed and if the template in Fig. 3.2a is 
known, then the radius of the most distant pole of X(z) from the origin can be deduced. 

On the basis of the above discussion, a discrete-time signal x(nT) can be uniquely determined 
from its z transform X(z) by simply obtaining the Laurent series that represents X(z) in its outer¬ 
most annulus of convergence as illustrated in Fig. 3.4. This can be accomplished by evaluating the 
coefficients of the Laurent series using the contour integral in Eq. (3.6), that is. 



where T is a closed contour in the counterclockwise sense enclosing all the singularities of function 
2f(z)z" . Equation (3.6) is, in effect, the formal definition of the inverse z transform. 



Figure 3.4 Evaluation of inverse z transform. 
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Like the Fourier transform and its inverse, the z transform and its inverse are often represented 
in terms of operator format as 

X(z) — Zx(nT) and x(nT) = Z~ l X(z) 


respectively. 

At first sight, the contour integration in Eq. (3.6) may appear to be a formidable task. However, 
for most DSP applications, the z transform turns out to be a rational function like the one in Eq. (3.3) 
and for such functions the contour integral in Eq. (3.6) can be easily evaluated by using the residue 
theorem (see Sec. A.7). According to this theorem, 

1 r p 

x(nT) = — <b X(z)z n ~ l dz = Y Wes \X{z)z n ~ 1 } (3.8) 

2itj J r 7Zi z ^ Pi 


where 9\es z ^ Pi [X(z)z n '] is the residue of X(z)z n 1 at pole p,. P is the number of poles in 
X(z,)z"~ The residue at a pole of order m, is given by 


d\es [A^z"” 1 ] 

Z=Pi 


1 


(m, - 1)! 


lim 

Pi 


d m ~ x 

dz" u ~ x 


[(2 


Pi rx(z)z n - 1 } 


(3.9a) 


which simplifies to 

93es, =p . [X(z)z n ~ l ] = lim [(z - p i )X(z)z n ~ 1 ] (3.9b) 


for a simple pole since no differentiation is needed and 0! = 1. Evidently, the residue at a first-order 
pole pj can be readily obtained by simply deleting the factor (z — p,) from the denominator of 
X(z)z"~ 1 and then evaluating the remaining part of the function at pole p,. 

The above method of inversion is known as the general inversion method for obvious reasons 
and its application will be examined in Sec. 3.8. 


3.6 THEOREMS AND PROPERTIES 

The general properties of the z transform can be described in terms of a small number of theorems, 
as detailed below. To facilitate the exposition we assume that 

Zx{nT) — X(z) Zx\{nT) — X\ (z) ZxJnT') — Xz (z) 

The symbols a, b, w, and K represent constants which may be complex. 

Most of the z transform theorems are proved by applying simple algebraic manipulation to the 
Z transform definition in Eq. (3.1). 

Theorem 3.3 Linearity 

Z\aX](nT) + bxiinT )] = aX\(z) + bX 2 (z) 


and 

Z~ 1 \aX 1 (z) + bX 2 (z )] = ax,(nT) + bx 2 (nT) 


Proof See Prob. 3.5. ▲ 
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Theorem 3.4 Time Shifting For any positive or negative integer m, 

Zx(nT + mT) = z"'X(z) 

Proof From the definition of the z transform 

OO 

Zx{iiT + mT) — Y^ x{nT + mT)z~" 

n——oo 

OO 

= Z m Y x[(n + m)T] Z - (n+m) 


If we now make the variable substitution n + m — n and then replace n’ by n, we have 

OO 

Zx(nT + mT) = z m Y x(nT)z~" = z m X(z ) A 

n =—oo 

If m is negative, then x(nT + mT) = x{nT — \m\T) and thus the signal is delayed by \m\T s. 
As a consequence, the z transform of a discrete-time signal which is delayed by an integer number 
of sampling periods is obtained by simply multiplying its z transform by the appropriate negative 
power of z. On the other hand, multiplying the z transform of a signal by a positive power of z causes 
the signal to be advanced or shifted to the left with respect to the time axis. 

Theorem 3.5 Complex Scale Change For an arbitrary real or complex constant w, 


Proof 


Z[w~ n x(nT)] = X(wz) 


OO 

Z[w~ n x(nT)] = [u r n x(nT)]z~ n 

n =—oo 
oo 

= Y x ( nT )( w z)~" 

n=—o o 

= X(wz) 


Evidently, multiplying a discrete-time signal by w " is equivalent to replacing z by wz in its z 
transform. If the signal is multiplied by v n , then we can write v n = (l/v)~" and thus 


Z[v n x(nT)] = Z 


(1) x(nT) 


= X(z/v) 


A 


Theorem 3.6 Complex Differentiation 

Z[nT lX (nT)] = 
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Proof 


oo oo 

Z[nT x x(nT)] = 22 nT lX (nT)z~ n = -T x z 22 x{nT){-n)z~ n ~ l 

n=—oo n=—oo 


= -TlZ 2^ *(nr) — {z~ n ) 

n=—oo 


= -Tiz 


dz 


22 x(nT)z 


-Tiz 


dX(z ) 
dz 


Changing the order of summation and differentiation is allowed in the last equation for values 
of z for which X(z ) converges. A 


Complex differentiation provides a simple way of obtaining the z transform of a discrete-time 
signal that can be expressed as a product nT\x(nT) by simply differentiating the z transform of X(z). 

Theorem 3.7 Real Convolution 


OO 

Z 22 xi(kT)x 2 (nT — kT) 

k ——oo 


oo 

Z 22 xi(nT - kT)x 2 (kT) 

k=—o o 

Xi (z)X 2 (z) 


Proof This theorem can be proved by replacing x(nT ) in the definition of the z transform by 
either of the above sums, which are known as convolution summations, then changing the order 
of summation, and after that applying a simple variable substitution, as follows: 


OO 

Z 22 xi(kT)x 2 {nT — kT) 

k ——oo 


E E x\(kT)x 2 (nT — kT) z " 

n =—oo U=-oo 
oo oo 

E E x\(kT)x 2 (nT — kT)z n 

k =—oo n =—oo 

oo oo 

22 xi(kT)z~ k 22 x 2 {nT - kT)z~ (n ~ k) 

k =—oo n=—o o 

oo oo 

22 Xi(nT)z~" 22 x 2 (nT)z~" 


= Xi(z)X 2 (z) 

Changing the order of the two summations in the above proof is valid for all values of z for 
which Xi(z), and X 2 (z) converge. A 
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Convolution summations arise naturally in the representation of digital filters and discrete-time 
systems as will be shown in Chap. 4. Consequently, the real-convolution theorem can be used to 
deduce z-domain representations for these systems, as will be shown in Chap. 5. 


Theorem 3.8 Initial-Value Theorem The initial value of x(nT) for a z transform of the 
form 


X(z) = 


N(z) 

D(z) 


EfioCHZ^ 
Ef=o hz »- 1 


(3.10) 


occurs at 


KT = (N - M)T A 


and the value of x(nT ) at nT — KT is given by 

x(KT) — lim[z*V(z)] A 

z —>oo 

Corollary If the degree of the numerator polynomial, N(z), in the z transform of 
Eq. (3.10) is equal to or less than the degree of the denominator polynomial D(z), then 
we have 


x{nT) — 0 for n < 0 


i.e., the signal is right sided. A 

Proof From the definition of the z transform 

OO 

X(z) = J2 x ( nT )z~" 

n=—oo 

If the initial value of x(nT) occurs at nT — KT. then 


OO 

X(z) = J2 x (nT)z~" = x(KT)z~ k + x(KT + T)z~ {K+l) + x(KT + 2T)z~ (K+2} + • • • 

n=K 


On dividing both sides by the first term, we have 

X(z) 1 x(KT + T)z~ ( k+1> x(KT + 2T)z~ ( k+2) 
x(KT)z~ k ~ + x(KT)z~ k + x(KT)z~ k + 
x(KT + T) | x(KT + 2T) 

+ x{KT)z + x(KT)z 2 + "' 

If we take the limit as z —>■ oo, we have 


lim 

z->o O 


X(z) 

x(KT)z~ k 


= 1 
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or 

x{KT) = lim [z K X(z)] 

z—>oo 

and from Eqs. (3.11) and (3.10), we can now write 
x(KT) = lim X(z)z K = lim 

Z—>OQ Z—>OQ 

a 0 _M-N „AT 
— - 7 • 7 

bo 

and since the left-hand side of the equation is independent of z, we get 


E m 

i=i 


i=0 


air 


ElobiZ* 


M - N + K = 0 


(3.11) 


Therefore, 


K = N - M A 

i.e., the initial value of x(nT) occurs at nT = KT, where K is the difference between the 
denominator and numerator degrees in X(z). 

With K known, x(KT) can be obtained from Eq. (3.11) as 

x(KT) — lim [z K X(z)] A 

z —^OO 

As has been demonstrated in the absolute-convergence theorem (Theorem 3.1), the z transform 
will not converge if x(nT) is nonzero at n = —oo. Consequently, a signal must start at some finite 
point in time in practice. The starting point of a signal as well as its value at the starting point are 
often of interest and Theorem 3.8 provides a means by which they can be determined. 

If the denominator degree in X(z) is equal to or exceeds the numerator degree, then the first 
nonzero value of x(nT) will occur at KT — ( N—M)T and if the condition of the Corollary is satisfied, 
i.e., N > M, then K > 0, that is, x(nT) = 0 for n < 0. On the basis of this Corollary, one can deter¬ 
mine by inspection whether a z transform represents a right-sided or two-sided signal. It is also very 
useful for checking whether a digital filter or discrete-time system is causal or noncausal (see Chap. 5). 

Theorem 3.9 Final Value Theorem The value of x(nT) as n —► oo is given by 

x(oo) = lim [(z — l)V(z)] 

z—>1 

Proof From the time-shifting theorem (Theorem 3.4) 

Z[x(nT + T) — x(nT )] = z,X(z) - X(z) = (z - 1 )X(z) (3.12) 

Alternatively, we can write 


n 

Z[x(nT + T) — x(nT)] — lim V [x(KT + T) - x(KT)]z~ n 

n—>oo ^^ 
k=—n 
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and if x(KT) is the first nonzero value of x(nT), we have 
Z[x(nT + T) — x{nT)] 

= lim [x(KT)z~ ( k ~ 1) + x(KT + T)z~ K - x(KT)z~ k 

n—>oo 

+ ■ ■ ■ + x{nT)z- (n ~ l) - x(nT - T)z~ {n ~ l) + x{nT + T)z~ n - x{nT)z~ n ] 

= lim [(z- (K ~ V) - z~ k )x{KT) + (z~ K - z~ (k+1> )x(KT + T) 

n—>oo 

+ • • • + (z“ ( "" 1) - z~ n )x(nT) + x(nT + T) Z ~ n ] 

T(z-l) (z — 1) (z — 1) 1 1 

= lim y -—^x(KT) + ———-x(KT + T) + -b -- -x(nT) + -x(nT + T) 

n—>oo £ A ' 1 zj 1 £ n 

(3.13) 

Now from Eqs. (3.12) and (3.13), we can write 

lim (z - l)X(z) 

z->l 

rcz-i) 

= lim lim -— -Z-x(KT) + 

z—> 1 n—>oo 

r(z—i) 

= lim lim --— x(KT) + 

n^-oo z—1 

= lim x(nT + T) 

n—>oo 

Therefore, 


(z - 1) 1 

• • • H- x(nT ) H-,i(flf + T) 

z" z" 

(z - 1) 1 

-1-—— x(nT) + —x(nT + T) 


v(oo) = lim [(z - l)X(z)] A 

z-> l 

The final-value theorem can be used to determine the steady-state value of a signal in the case 
where this is finite. 

Theorem 3.10 Complex Convolution If the z transforms of two discrete-time signals xfnT) 
and X 2 (nT) are available, then the z transform of their product, X 3 (z), can be obtained as 


X 3 (z) = Z[ Xl (nT)x 2 (nT )] = — / X l (v)X 2 (-\ v~ l dv (3.14a) 

2tt/ ,/r, \vJ 

= 1 . i X 3 ( Z ) X 2 (v)v~ l dv (3.14b) 

2 t vj J r2 \vJ 


where T | (orT 2 ) is a contour in the common region of convergence of X\(v) and X 2 (z / v) (or 
X\(z/v) and X 2 (v)). The two contour integrals in the above equations are equivalent. 
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Proof From the definition of the z transform and Eq. (3.6), we can write 

oo 

X 3 (z) = ^2 [xi(nT)x 2 (nT)]z~" 


= 5Z x i( nT ) 


— <p x 2 (v)v n ~ l 2 3 4 dv 
r 2 


1 

2 nj 


r 2 


X 2 (v)v 1 dv 


2 nj 

OO 

E x ' (nT) 0 

=—oo 

= ([ Xi (-) X 2 (v)v~ l dv 

2ttj J r , \v / 

The order of integration and summation has been interchanged in the last but one line and this 
is, of course, permissible if contour T 2 satisfies the condition stated in the theorem. A 


The obvious application of Theorem 3.10 is in obtaining the z transform of a product of 
discrete-time signals whose z transforms are available. The theorem is also vital in the design of 
nonrecursive digital filters, as will be shown in Chap. 9. 

Like the contour integral for the inverse z transform, those in Eq. (3.14) appear quite challeng¬ 
ing. However, the most difficult aspect in their evaluation relates to identifying the common region 
of convergence alluded to in the theorem. Once this is done, what remains is to find the residues of 
X\{z/v)X 2 {v)v~ l or X\(z/v)X 2 (v)v~ x at the poles that are encircled by contour Ti or P 2 , which 
can be added to give the complex convolution. The complex convolution can be evaluated through 
the following step-by-step technique: 


1. Obtain the zero-pole plots of Xi(z) and X 2 (z.) and identify the region of convergence for each, 
as in Fig. 3.5a and b. 

2. Identify which of the two z transforms has the larger radius of convergence. If that of X \ (z) is 
larger, evaluate the contour integral in Eq. (3.14a); otherwise, evaluate the integral in Eq. (3.14b). 
In Fig. 3.5, Xi(z) has a larger radius of convergence than X 2 {z) and hence the appropriate integral 
is the one in Eq. (3.14a). 

3. Replace z by v in Xi(z) and z by z/v in X 2 (z). Switch over from the z plane to the v plane at 
this point and plot the regions of convergence in the v plane. This can be accomplished as in 
Fig. 3.5c and d. The region of convergence in Fig. 3.5c is identical with that in Fig. 3.5(7 since the 
only change involved is a change in the name of the variable. In Fig. 3.5 cl, however, a so-called 
conformal mapping (or transformation) (see Sec. A.9) is involved. We note that if v —> oo, 
then z/v —> 0 and if v -> 0, then z/v -> oo; therefore, the region outside (inside) the radius 
of convergence in Fig. 3.5 b maps onto the region inside (outside) the radius of convergence in 
Fig. 3.5 d, as shown. 

4. Since the radius of convergence in Fig. 3.5 b has been assumed to be smaller than that in Fig. 3.5a, 
it follows that the radius of the shaded region in Fig. 3.5 d is larger than that of the unshaded 
region in Fig. 3.5c. The area that appears shaded in both Fig. 3.5c and d, illustrated in Fig. 3.5e, 
is the common region of convergence of the product X\fz/v)X 2 {v)v~ l . 
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X t (z) z plane 


(a) 


X 2 (z) Z plane 



X[(d) v plane X 2 (z/v) v plane 





(c) 


(d) 



(e) 

Figure 3.5 Complex convolution. 


5. The integral is found by identifying the poles of X\(z/v)X 2 (v)v 1 that are located inside the 
inner circle in Fig. 3.5e, finding the residues at these poles, and adding them up. 


The technique is illustrated by Example 3.2 in Sec. 3.7. 

In certain applications, contour Fi or Tt can be a circle in the common region of convergence 
and hence we can write v = pe '° and z = re J,f>> . In these applications, the above complex convolution 
integrals become real-convolution integrals. For example, Eq. (3.14b) gives 


X 3 (re jc> ) 



P 


X 2 (pe je )d6 


(3.15) 


(see Prob. 3.6, part (a)). 
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Theorem 3.11 Parseval’s Discrete-Time Formula If X(z) is the z transform of a discrete¬ 
time signalx(nT), then 


Y \x(nT )| 2 


i roj s 

— / \X(e J “ T )\ 2 du; 

us Jo 


(3.16) 


where u> s — 2i t/T. 


Proof Parseval’s discrete-time formula can be derived from the complex-convolution theorem. 
Although the discrete-time signal x(nT) has been implicitly assumed to be real so far, the z 
transform can be applied to a complex signal x{nT) just as well as long as X(z) converges. 
Consider a pair of complex-conjugate signals x\{nT) and xoirTf) such that 


X\(nT) = x{nT) 


and 


X 2 {nT) — x*(nT) 


We can write 


Xdz) = X(z) 


(3.17a) 


(3.17b) 


(3.18a) 


and 


X 2 (z) = Y x*0iT)z~ n = 


Y x(nT){z ') 


= X*(z _1 ) 


(3.18b) 

From the complex-convolution theorem (Eq. (3.14a)) and the definition of the z transform, we get 

(3.19) 


Z[x\(nT)x 2 (nT)] — - (j> Xi(v)X-, f-'l v 1 

2nj J Fl \vl 


Equations (3.17)—(3.19) give 


oo i - 

^2 [x{nT)x\nT)]z~ n = - : <b X(v)X * (^j iT 1 dv (3.20) 

n=—na Z, 


and if we let z — 1, we obtain 


oo If 

Y \x{nT)\ 2 = — f \X{v)\ 2 v~ l dv 


Now if we let v = e 1 "’ 7 , contour Ti becomes the unit circle and the contour integral becomes a 
regular integral whose lower and upper limits of integration become 0 and lit/T, respectively. 
Simplifying, the real integral obtained yields Parseval’s relation. 
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For a normalized signal, namely, for the case where T = 1, co s = 2n / T = 2n and hence 
Parseval’s summation formula assumes the more familiar form 

00 J /»2 TC 

]T|x(n )| 2 = — / \X(en\ 2 dco A 

Note, however, that this formula will give the wrong answer if applied to a signal which 
is not normalized. A 

Parseval’s formula is often used to solve a problem known as scaling, which is associated with 
the design of recursive digital filters in hardware form (see Chap. 14). 


3.7 ELEMENTARY DISCRETE-TIME SIGNALS 

The analysis of analog systems is facilitated by using several elementary signals such as the unit 
impulse and the unit step. Corresponding discrete-time signals can be used for the analysis of 
DSP systems. Some of the basic ones are defined in Table 3.1 and are illustrated in Fig. 3.6. The 
discrete-time unit step , unit ramp, exponential, and sinusoid are generated by letting t = nT in the 
corresponding continuous-time signals. The discrete-time unit impulse S(nT), however, is generated 
by letting t = nT in the unit pulse function of Fig. 2.6a, which can be represented by the equation 


Pi(t) = 


for |?| < r/2 < T 
otherwise 


Note that S(nT) cannot be obtained from the continuous-time impulse 8(t) which is usually 
defined as an infinitely tall and infinitesimally thin pulse (see Sec. 6.2.1). Nevertheless, the discrete- 
and continuous-time impulse signals play more or less the same role in the analysis and representation 
of discrete- and continuous-time systems, respectively. 

Table 3.1 Elementary discrete-time signals 


Function 


Unit impulse 


Unit step 


Definition 


Unit ramp 


8{nT) = 


u{nT) = 



Sinusoid 


u(nT) sin conT 
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(a) 


C b ) 





Figure 3.6 Elementary discrete-time functions: (a) Unit impulse, ( b ) unit step, (c) unit ramp, (d) increasing 
exponential, (e) decreasing exponential, (c) sinusoid. 

The application of the z transform to the elementary functions as well as to some other discrete¬ 
time signals is illustrated by the following examples. 


Example 3.1 


(e) u(nT)e 


Find the z transforms of (a) S(nT), (b) u(nT), (c) u(nT — kT)K, (d) u(nT)Kw'\ 
T , (f) r(nT), and (g) u(nT)sina>nT (see Table 3.1). 


■ Solution 

(a) From the definitions of the z transform and S(nT ), we have 

ZS(n T) = 5(0) + j(r)z -1 + S(2T)z~ 2 + • • ■ = 1 ■ 

(b) As in part (a) 

ZuinT) = u( 0) + u(T)z~ l + u(2T)z~ 2 + ■ ■ ■ = 1 + + z" 2 + ■ ■ ■ 
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The series at the right-hand side is a binomial series of (1 — z 1 ) *, (see Eq. (A.47)). 
Hence, we have 

Zu{tiT) = (1 — z^ 1 ) -1 = —- ■ 

z - 1 

(c) From the time-shifting theorem (Theorem 3.4) and part (£>), we have 

K 7—(^—ri 

Z[u(nT - kT)K] = Kz~ k Zu(nT) = — - ■ 

z - 1 

(d) From the complex-scale-change theorem (Theorem 3.5) and part (b). we get 

—n 


Z[u{nT)Kw n ] = KZ 


u(nT) 


= K Zu(nT)\ z ^ z/u 


Kz 


z — w 


( e ) By letting K — 1 and w = e 011 in part ( d ), we obtain 


Z[u{nT)e~ anT ] = 


z — e 


(/) From the complex-differentiation theorem (Theorem 3.6) and part (b), we have 


Zr(nT) = Z[nTu(nT )] = — Tz — [Zu(nT)] 

dz 


d 

~ ~ TZ Tz 


(z-1). 


Tz 


iz - l) 2 


(g) From part (e), we deduce 


Z[u(nT) sin conT] — Z 


u(nT > / jconT _ —jo)nT\ 

2 j 1 ’ 


= fwnry*']- T 2[»(ni-r'" r ] 


1 (— - — ) 

2 j \z — ei mT z — e ) 

z sin a>T 

z 2 — 2z coscoT + 1 
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Example 3.2 


Find the z transform of 


x 2 (nT) = u(nT)e sin conT 


where a < 0. 


■ Solution 


Evidently, we require the z transform of a product of signals and, therefore, this is a clear 
case for the complex convolution of Theorem 3.10. Let 

x\(nT) = u(nT) sin wnT and x 2 (nT) = u(nT)e~ anT 


From Example 3.1, parts ( g ) and (e), we have 


Xdz) 


z sin coT 

(z — ej mT )(z — e~J loT ) 



We note that X t (z) has a complex-conjugate pair of poles at e ± ' , " )T whereas X 2 (z) has 
a real pole at z — e~ aT . Since e ±/V " 7 ' = 1, the radius of convergence of X \ (z) is unity 
and with a assumed to be negative, the radius of convergence of (z) is less than unity. 
Thus, according to the evaluation technique described earlier, the correct formula to use 
is that in Eq. (3.14a) and, by a lucky coincidence, the mappings in Fig. 3.5 apply. 

Now 

v sin coT 

^ (v — e JtoT )(v — e~ JloT ) 
and thus it has poles at v = e ±J '” T . On the other hand. 


X 2 (z/v) = 


z — e 


z/v 


-ze 


z ^ z/v z/v - e- 


v — ze“ 


and, as a result, it has a pole at v = ze aT . Hence the common region of convergence of 
Xi(u) and X 2 {z/v) is the annulus given by 


1 < M < ze aT 


as depicted in Fig. 3.7. Therefore, the complex convolution assumes the form 

X 2 (z) = 1 . (f ^i(u)^2 (-) v~ l dv 

2jxj J Fl \v / 

1 / — ze aT sin coT 

= - ® -T-T- dv 

2 nj J r (v — ze aT )(v — e J<o:r )(v — e~j wT ) 
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where Tj is a contour in the annulus of Fig. 3.7. By evaluating the residues of the 
integrand at v = e +JcoT and , we obtain 


X 3 (z) = 


— ze al sin toT 


(n — ze aT )(v — e~-i‘ oT ) 
■ aT sin coT 


v=e ja>T 


+ 


-ze“ 


(v - ze aT )(v - eJ (oT ) v _ e ~jmT 
ze~ aT sin coT 

z 2 — 2ze~ aT cos wT + e~ 2aT 


The radius of convergence of X 3 (z) is equal to the magnitude of the poles, which is given 
by the above equation as \/e~ 2olT — c r " r . Alternatively, the annulus of convergence in 
Fig. 3.7 exists, if \ze aT \ > 1, that is, X 3 (z) converges if |z| > e~ aT . 

The above approach was used primarily to illustrate the complex-convolution theorem 
which happens to be quite important in the design of nonrecursive filters (see Chap. 9). 
A simpler approach for the solution of the problem at hand would be to use the complex- 
scale-change theorem (Theorem 3.5), as will now be demonstrated. From Example 3.1, 
part (g), we have 


Z[u(nT) sin conT] 


z sin coT 

z 2 — 2zcos coT + 1 
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and from the complex-scale-change theorem, we can write 

Z[w~ n x(nT)] = X(wz) 


Hence 


Z[u(nT)w "sin conT] 


Now with w = e aT , we deduce 


wz sinaiT 

(wz) 2 — 2{wz) cos coT + 1 
zw~ l sin cur 

z 2 — 2zw~ 1 cos u>T + w ~ 2 


Z[u(nT)e~ anT sincunT] 


ze aT sin cur 

z 2 — 2ze~ aT cos coT + e~ 2aT 


A list of the common z transforms is given in Table 3.2. A fairly extensive list can be found in 
the work of Jury [1]. 


Table 3.2 Standard z transforms 
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3.8 Z-TRANSFORM INVERSION TECHNIQUES 

The most fundamental method for the inversion of a z transform is of course the general inversion 
method described in Sec. 3.5 since this is part and parcel of the Laurent theorem (Theorem A.4). 

If X(z)z"~ [ has only first- or second-order poles, the residues are relatively easy to evaluate. 
However, certain pitfalls can arise that could cause errors. To start with, if X(z) does not have a 
zero at the origin, the presence of z" 1 in X(z)z n ~ 1 will introduce a first-order pole at the origin for 
n = 0, and this pole disappears for n > 0. This means that one would need to carry out two sets of 
calculations, one set to obtain x(nT) for n — 0 and one set to obtain x(nT ) for n > 0. This problem 
is illustrated in the following example. 



Using the general inversion method, find the inverse z transforms of 


(a) 



(b) 


1 


X(z) = - 7 -ry 

2(z-l)(z+±) 


■ Solution 


(a) We can write 


_ (2z - 1)Z ■ z"-‘ _ (2z - l)z" 

” 2(z-l)(z+I) “ 2(Z- l)(z+ \) 


We note that X(z)z n ~ 1 has simple poles at z = 1 and — (. Furthermore, the zero 
in X(z) at the origin cancels the pole at the origin introduced by z" _1 for the case 
n = 0. Hence for any n > 0, Eq. (3.8) gives 


x(nT) = 9ies [Z(z)z"“ 1 ] + Kes^ [Z(z)z n -'] 


(2z - 1 )z" (2z - l)z" 

2(^+D z=1 + 2(z-l) , = _i 



Since the numerator degree in X(z) does not exceed the denominator degree, x(nT) is a 
one-sided signal, i.e., x(nT) = 0 for n < 0, according to the Corollary of Theorem 3.8. 
Therefore, for any value of n, we have 


x(nT) = u(nT) f + f (-j)" ■ 
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(, b ) In this z transform, X(z) does not have a zero at the origin and, as a consequence, 
z"~ l introduces a pole in X(z)z"~ l at the origin for the case n = 0, which must be 
taken into account in the evaluation of x(0). Thus for n = 0, we have 


-n— 1 




„ =0 2z(z-l)(z + s) 


Hence 


x(0) = 


1 


2( Z -I)(z+I) 

1 

+ 2z(z - 1) 


z=0 


2z ( Z + 5 ) 


Z— 1 


, - -1 + 3 + 3 - 0 

z= ~2 


Actually, this work is unnecessary. The initial-value theorem (Theorem 3.8), gives 
x(0) = 0 without any calculations. 

On the other hand, for n > 0 


,n—1 


x(nT) = 


2 ( z + 5 ) 


1 


= 1-1 f-I) 

3 3 V 2 ) 


+ 
z= 1 
n-1 


2(z - 1) 


1 

Z=-o 


and as in part (a), x(nT) = 0 for w <0. Thus, for any value of we have 
x(nT) = u(nT ■ 


The general inversion method tends to become somewhat impractical for z transforms of two- 
sided signals whereby x(nT) is nonzero for negative values of ri. For such z transforms, X(z)z n ~ l has 
a higher-order pole at the origin whose order is increased as n is made more negative. And the residue 
of such a pole is more difficult to evaluate since a higher-order derivative of a rational function in 
Z needs to be calculated. However, the problem can be easily circumvented by using some other 
available inversion techniques, as will be shown next. 

Owing to the uniqueness of the Laurent series in a given annulus of convergence, any technique 
that can be used to generate a power series for X(z) that converges in the outermost annulus of 
convergence given by Eq. (3.7) can be used to obtain the inverse z transform. Several such techniques 
are available, for example, by 

• using binomial series, 

• using the convolution theorem, 

• performing long division, 

• using the initial-value theorem (Theorem 3.8), or 

• expanding X(z) into partial fractions. 
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3.8.1 Use of Binomial Series 

A factor (1 + b) r , where r is a positive or negative integer, can be expressed in terms of the binomial 
series given by Eq. (A.47) and by letting r = — 1 in Eq. (A.47), we obtain 

(1 + b)~ l = 1 + {-b) + b 2 + {-bf + • ■ ■ (3.21a) 

and if we replace b by —b in Eq. (3.21a), we get 

(1 - b )-' = [1 + (—&)]-' = 1 + b + b 2 + b 2 + ■ ■ ■ (3.21b) 

By applying the ratio test of Theorem A.3, the series in Eqs. (3.21a) and (3.21b) are found to 
converge for all values of b such that \b\ < 1. Thus if b — w/z, the series converges for all values 
of z such that |z| > |w| and if b = z/w, then it converges for all values of z such that |z| < |u;|. 

By expressing X(z) in terms of factors such as the above with either b — w/z or b — z/w as 
appropriate and then replacing the factors by their binomial series representations, all the possible 
Laurent series for A(z) centered at the origin can be obtained. If we have b — w/z in all the factors 
then the above series as well as the series obtained for X(z) converge in the outermost annulus 

|w| < |z| < Roo for Roc —► oo 

which makes the series a z transform by definition. If we have b = z/w in all the factors, then their 
series and the series obtained for X(z) converge in the innermost annulus, namely, 

R 0 < \z\ < M for R 0 -> 0 

On the other hand, if we have b = w/z in some factors and b = z/w in others, then the series 
obtained for X(z) will converge in one of the in-between annuli of convergence. 


Example 3.4 


Using binomial series, find the inverse z transform of 


X(z) = 


Kz m 
(z — w) k 


where m and k are integers, and K and w are constants, possibly complex. 


■ Solution 


The inverse z transform can be obtained by finding the Laurent series that converges 
in the outermost annulus and then identifying the coefficient of z", which is x(nT ) by 
definition. Such a series can be obtained by expressing X(z) as 


X{ Z ) = Kz m ~ k [l + {-wz~ l )Y k 


= Kz 


m—k 


(—wz ') + 


1\2 


( WZ ) 




(• -wz ~')" + 
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where 


/ —k\ _ -k(-k - 1)... (-k - n + 1) 
\ n J n\ 


according to Eq. (A.48). Now if we let n = n' + m — k and then replace n by n, we have 

OO 

X(z) = E{ Ku[(n + m — k)T\ 

n=— oo 

(—k)(—k - 1) m + 1 )(-w) n+m ~ k t 

x->z 

(n + m — k )! J 

Hence the inverse z transform, which is the coefficient of z~ n , is obtained as 


x(nT) = Z 


Kz " 


(z - w) k 
— Ku[{n + m — k)T\ 

(—k)(—k -!)••• (—n - m + 1 ){-w) n+m ~ k 


x 


(n + m — k)\ 


Incidentally, this is a fairly general inverse z transform since seven of the twelve inverse 
Z transforms in Table 3.2 can be derived from it by choosing suitable values for the 
constants k, K, and m. 


Example 3.5 


(a) Using binomial series, find all the Laurent series of 


X(z) = 


Cz 2 ~ 4) 

z(z 2 - l)(z 2 + 4) 


(3.22) 


with center at the origin of the z plane. (/;) Identify which Laurent series of ATz) is a z transform. 


■ Solution 

The zero-pole plot of X(z) depicted in Lig. 3.3a has three distinct annuli of convergence, 
namely, Aj, A n , and A m as illustrated in Fig. 3.3c/. The radius of the inner circle of annulus 
Ai can be reduced to zero and that of the outer circle of annulus Am can be increased to 
infinity. Thus three Laurent series can be obtained for this function, one for each annulus. 


Annulus A\: To obtain the Laurent series for the innermost annulus of convergence in 
Fig. 3. 3d, that is, Ai, X(z) must be expressed in terms of binomial series that converge 
for values of z in the annulus Rq < |z| < 1 where Rq —> 0. Equation (3.22) can be 
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expressed as 


X(z) = 


(z 2 - 4) 

z(z 2 - 1 )(z 2 + 4) 


(z 2 - 4) 


—4z(l — z 2 )(l + z 2 /4) 

(z 2 — 4)(1 — z 2 )~*(l + z 2 /4)~ 1 
-4z 


From Eqs. (3.21b) and (3.21a), we have 


(1 - z 2 )- 1 = 1 + z 2 + (z 2 ) 2 + . . . + (Z 2 )" + . . . 


(3.23) 


(3.24a) 


and 


(1 4~ z 2 /4) —1 = [1 - (-ZV4)]- 1 

= 1 + (—z 2 /4) + (—z 2 /4) 2 + • • • + (-z 2 /4) k + ■■■ (3.24b) 


respectively. Since both of the above series converge and (z 2 — 2)/(—4z) is finite for 
0 < |z| < 1, the substitution of Eqs. (3.24a) and (3.24b) into Eq. (3.23) will yield a 
series representation for X(z) that converges in annulus A t . We can write 


X(z) = 


(z 2 -4)(l-z 2 r 1 (l+z 2 /4r 1 
—4z 

( ~ ~ 4> [i+z 2 + --- + (z 2 r + 

—4z 


•]■[! + (—z 2 /4) +-b (—z 2 /4)* 


2 _ 4 oo oo / 2 


n =0 ife=0 


and after some routine algebraic manipulation, the series obtained can be expressed as 


oo 

X(z) = z~ l + Y J C n z 2n ~ l ■ (3.25) 

n= 1 


where 


c n = 1+2EH)' 


A:=l 
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The sum in the formula for C n is a geometric series with a common ratio of — 1 /4 and 
hence it can be readily evaluated as 



and on calculating the coefficients, the series in Eq. (3.25) assumes the form 

A(z) = • • • + ||z 5 + gz 3 + \z + z 1 (3.26) 


Annulus An (see Fig. 3.3 d): A series that converges in annulus An, that is, 1 < |z| < 2, 
can be obtained in the same way. Equation (3.22) can be expressed as 


^ z(z 2 — l)(z 2 + 4) 

= (z 2 - 4) 

4z 3 (l - l/z 2 )(l +z 2 /4) 

(z 2 — 4)(1 — l/z 2 ) _1 (l + z 2 /4) _1 


where 


(1 - l/z 2 )- 1 = 1 + (1/z 2 ) + (1/z 2 ) 2 + • • • + (1/z 2 )" + • • • (3.28) 


and (1 + z 2 /4) _1 can be expressed in terms of the binomials series in Eq. (3.24b). The 
series in Eqs. (3.24b) and (3.28) converge in the region 1 < |z| < 2, as can be easily 
shown by using the ratio test, and since (z 2 — 4)/4z 3 is finite for Izl > 0, and from 
Eq. (3.27) a series representation for X(z ) for annulus An can be obtained as 


,2 !A\-\ 


X(z) = 


(z 2 - 4)(1 - 1/z )~ ( 1 + z /4) 
4z 3 


[1 + (1/z^) H-h (1/z 2 )” H-] 


(z 2 - 4) 

4z 3 

•[ 1 + C—z 2 /4) H-h (— z 2 /4) a H-] 


4z 3 


EE (i 

n =0 k =0 V 
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After some manipulation and some patience, the series obtained can be simplified to 

OO 

X(z) = Y (£»z 2 " _3 - fz" (2n+1) ) ■ (3.29) 

n =1 

where 


E 


n 


2 

5 



n— 1 


If we calculate the numerical values of the coefficients in Eq. (3.29), we get 

X(z) = ■ ■ ■ + - ± z + fz" 1 - §*-3 - fz" 5 - ... ( 3 . 30 ) 

Annulus Am (see Fig. 3.3 d): A series that converges in annulus Am, that is, 2 < |z| < 
Roc, can be obtained by expressing X(z) in Eq. (3.22) as 


where 


X(z) = 


(z 2 - 4) 

z(z 2 - 1 )(z 2 + 4) 


(z 2 ~ 4) 

z 5 (l - l/z 2 )(l + 4/z 2 ) 

(z 2 — 4)(1 - l/z 2 r 1 (l + 4/z 2 )- 1 


(3.31) 


(1 + 4/z 2 )- 1 = [1 - (-4/z 2 )]' 1 

= 1 + (-4/z 2 ) + (-4/z 2 ) 2 + ■ ■ ■ + (—4/z 2 )* + ■ ■ ■ 

(3.32) 

and (1 — 1/z 2 ) -1 can be represented by the binomial series in Eq. (3.28). The series in 
Eqs. (3.28) and (3.32) converge in the region 2 < |z| < oo and since (z 2 — 4)/z 5 is 
finite for |z| < oo, a series representation for X(z) for annulus Am can be obtained from 
Eq. (3.31) as 


(z 2 -4)(l- 1 /z 2 )-‘(1+4/z z ) 


X(z) = 


, 2\—1 


(z 2 - 4) 


[l + (l/z 2 ) + ... + (l/z 2 )" + ...] 


•[1 + (—4/z 2 ) H-+ (—4/z 2 )* + ■ ■ ■ ] 


oo oo / i \ n / 

EE i) - 


n=0 k=0 
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After quite a bit of algebra, one can show that 

OO 

X(z) = GnZ~ 2n ~ 3 m (3.33) 

n =0 


where 


with 


Hence 


G„ = F n - 4 


f « = Y, ( - 4)k = H 1 - (-4) ,!+1 ] 

k=0 


G„ = i [-3 + 8(—4)"] 

and on evaluating the coefficients in Eq. (3.33), we get 

X(z) = z" 3 - lz~ 6 + 25z -7 - 103z -9 + • • • (3.34) 

( b) A comparison of Eqs. (3.26), (3.30), and (3.34) shows that the three Laurent series 
obtained for X(z) are all linear combinations of positive and/or negative powers of z and 
are, in fact, quite similar to each other. Yet only the last one is a z transform that satisfies 
the absolute-convergence theorem (Theorem 3.1) since this is the only Laurent series 
that converges in the outermost annulus. ■ 


3.8.2 Use of Convolution Theorem 

From the real-convolution theorem (Theorem 3.7), we have 


OO 

Z- l [X 1 (z)X 2 (z))= MikT) Xl {nT - kT) 

k=—o o 

Thus, if a z transform can be expressed as a product of two z transforms whose inverses are available, 
then performing the convolution summation will yield the desired inverse. 


Example 3.6 


Using the real-convolution theorem, find the inverse z transforms of 


(a) 

ib) 




z 

(z - l) 3 


Y 4 (z) = 
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■ Solution 

(a) Let 

Xi (z)= ——- and X 2 (z) = — 

z— 1 z — 1 

From Table 3.2, we can write 

x\(nT) = u(nT) and x 2 (nT) = u(nT — T) 

and hence for n > 0, the real convolution yields 

OO OO 

x 2 (nT) = Y x\{kT)x 2 {nT — kT) = Y u(kT)u(nT - T - kT) 

k =—oo k=—oo 

k=- 1 k= 0 

/-^-s /-*-s 

= • • • + u(—T)u(nT ) + u(0)u(nT — T) 

k= I k=n— 1 

/-^-s /-^-s 

+ u(T)u(nT -2 T)-\ -b u(nT - T)u( 0) 

k=n 

/-^-s 

+ u(nT)u( —T) + ■ • • = 0 + 1 -b 1 d - • • ■ T 1 -b 0 = zz 

For n < 0, we have 

00 

x 3 (nT) = Y u(kT)u(nT - T - kT) 

k =—oo 

k=- 1 £=0 fc=l 

,--s ,- A -s ,- A -s 

= • • • + u(—T)u(nT) + u(0)u(nT — T) + u(T)u(nT — 2 T) 

k—n— 1 k—n 

+ ■ ■ ■ + u(nT — T)u( 0) + u(nT)u(—T ) + ■ ■ ■ 
and since all the terms are zero, we get 

x 2 (nT) — 0 

Alternatively, by virtue of the initial-value theorem, we have x 2 (iiT) = 0 since the 
numerator degree in X 2 (z) is less than the denominator degree. 

Summarizing the results obtained, for any value of n, we have 

x 2 (nT) = u(nT)n m 

( b ) For this example, we can write 

Xi(z) = 7 —~Ta and x 2(z) = —^—r 

(z - 1 r z - 1 
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and from part (a), we have 

x\(nT ) = u(nT)n and X 2 (nT) — u(nT — T) 

For n > 0, the convolution summation gives 

oo 

x 3 (nT) = Y ku(kT)u(nT — T — kT) 

k =—oo 

k =0 k= 1 k=n—l k—n 

= + 0- [u(nT - r)]+'l • [u(nT -2T)] + ---+ / (fY^)u(0) + nu(^T) 

= +0+1+2+-fra — 1 + 0 

n— 1 

= J2 k 

k=\ 

Now by writing the series 1,2,... , n — 1 first in the forward and then in the reverse 
order and, subsequently, adding the two series number by number as follows a series of 
n — 1 numbers, each of value n, is obtained: 

1 2 3 ■■■ n-\ 

n — In — 2 n — 3 1 


n n n n n 

Hence, twice the above sum is equal to 1 (n — 1) x n and thus 

n— 1 

Xj (nT) = = \n(n — 1) 

k= 1 

For 7i < 0, Xi(nT) = 0, as in part (a) and, therefore, 

n— 1 

Xi(nT) = k = ju(nT)n(n — 1) ■ 

k=\ 


3.8.3 Use of Long Division 

Given a z transform X(z) = N(z)/D(z), a series that converges in the outermost annulus of X(z) can 
be readily obtained by arranging the numerator and denominator polynomials in descending powers 
of z and then performing polynomial division, also known as long division. The method turns out to 


1 Gauss is reputed to have astonished his mathematics teacher by obtaining the sum of the numbers l to 100 in just a 
few seconds by using this technique. 
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be rather convenient for finding the values of x(nT) for negative values of n for the case where the z 
transform represents a two-sided signal. However, the method does not yield a closed-form solution 
for the inverse z transform but the problem can be easily eliminated by using long division along 
with one of the methods that yield closed-form solutions for right-sided signals. The method is best 
illustrated by an example. 


Example 3.7 


Using long division, find the inverse z transform of 


_i + 1, _ 1,2 _ Z,3 + 2^ 4 + 7 5 

X(z) = 4 2 , 2 , - 4 2 3 

-? + \z-z 2 + z 3 

i Solution 

The numerator and denominator polynomials can be arranged in descending powers of 
z as 

,5 + 2z 4 - Z 7 3 _ I 7 2 + 1, _ I 

x(z) = + \ 4Z 7 r 1 2 4 

Z 3 - Z 2 + \z - 4 

Long division can now be carried out as follows: 

z 2 + 3z + 1 + z“ 2 + z -3 


2,1 i 

■ z + jZ — 4 


z 5 + 2 z 4 ■ 


7,3 12,1 

aZ 9 Z I 9 Z ' 


T z 5 ± z 4 T k 3 ± iz 2 


3z 4 — jz 3 — |z 2 + \ z ~~ 5 


T3z 4 ± 3z 3 =f |z 2 ± \z 


z 3 - z 2 + \z - 5 
=FZ 3 ± z 2 T k ± 3 


=FZ± 1 =F iz ' ± Iz 2 


1 - Iz- 1 + k“ 2 
T i±z-' T k _2± k -3 


3 ,- 1 , 1 ,-3 

4 Z + 4 Z 
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Hence 

X(z) = z 2 + 3z + 1 + z~ 2 + z -3 H- 

and, therefore, 

x(-2T)=l x(-T) = 3 x(0) = 1 x(T) = 0 x(2T)=l,... m 


In Example 3.7, one could obtain any number of signal values by continuing the long division 
but open-ended solutions such as the one obtained are not very convenient in practice. A better 
strategy would be to continue the long division until x(0) is obtained. At that point, X(z) can be 
expressed in terms of the quotient plus the remainder as 

X(z) = Q(z ) + R(z) 


where 


*(z) = 


N'(z) 

D(z) 


The inverse z transform can then be obtained as 

x(nT) = Z~ l [Q(z) + R(z)] 

= Z~ l Q(z) + Z~ l R(z) 

by virtue of the linearity of the inverse z transform. Since K(z) represents a right-sided signal, its 
inverse Z~ l R{z) can be readily obtained by using any inversion method that yields a closed-form 
solution, for example, the general inversion method. 

For the z transform in Example 3.7, we can write 

Q(z ) = z 2 + 3z + 1 and R(z) = —- l - r 

Z 3 - L 2 + - 4 


Thus 


x(nT) = Z- l Q(z) + Z~ l R(z) 

= Z-\z 2 + 3z+l) + Z~ 1 

As may be recalled, the general inversion method is very convenient for finding x(nT) for n > 0 
but runs into certain complications for n < 0. On the other hand, the long division method is quite 
straightforward for n < 0 but does not give a closed-form solution for n > 0. A prudent strategy 
would, therefore, be to use the hybrid approach just described. 


7 3 — -2 


Z z + jZ~ 









THE Z TRANSFORM 113 


It is important to note that if long division is performed with the numerator and denominator 
polynomials of X(z) arranged in ascending instead of descending powers of z, a Laurent series is 
obtained that converges in the innermost annulus about the origin, i.e., for 


R 0 <r<R 


where Rq —> 0 and R is the radius of the circle passing through the pole nearest to the origin. Such 
a series is not considered to be a z transform in this textbook, as explained in Sec. 3.5. 

3.8.4 Use of Initial-Value Theorem 

Theorem 3.8 can be used to find the initial value of x(nT), say, x(KqT). The term x(K (} T)zr K " can 
then be subtracted from X(z) to obtain 


X'(z) = X{z) - x(KqT)z~ k ° 


Theorem 3.8 can then be used again to find the initial value of x'(nT), say, x'(K\ T). The term 
x'(K\T)z~ k ' can then be subtracted from X'(z.) to obtain 


X"(z) = X'(z)- x\KiT)z~ Ki 


and so on. This method, just like the long-division method, is useful for obtaining the values of x(n T) 
for negative values of n but, like long division, it does not yield a closed-form solution. 



Find x(nT ) for n < 0 for 


X(z) = 


3z 5 + 2z 4 - 2z 3 - 2z 2 - z + 4 
z 2 — 1 


■ Solution 


Since the numerator degree in X(z) exceeds the denominator degree, x(nT) is nonzero for 
some negative values of n. From Theorem 3.8, the first nonzero value of x(nT) occurs at 


KT = (N - M)T = (2 - 5 )T = -37 


i.e., K = —3, and the signal value is given by 


x(—3T) = lim — 

z^oo Z' 


X(z) 3 z 5 + 2z 4 - 2z 3 - 2z 2 - z + 4 


(z 2 - l)z 3 
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Now if we subtract 3 z 3 from X(z) and then apply Theorem 3.8 again, the second nonzero 
value of x(nT) can be deduced. We can write 


X(z) - 3z 3 


3z 5 + 2z 4 - 2z 3 - 2z 2 - z + 4 „ 3 

- 2 - 1 - 32 

Z 2 - 1 

3z 5 + 2z 4 - 2z 3 - 2z 2 - z + 4 - 3z 5 + 3z 3 

z 2 — 1 

2z 4 + z 3 - 2z 2 - z + 4 

z 2 — 1 


Hence 


and 


KT = (N - M)T = (2 - 4 )T = -2 T 


, v [2f(z)-3z 3 ] 2z 4 + z 3 — 2z 2 — z + 4 

x(-2T) = lim -x-= lim -— 5 ^- 

z—>oo z z—>oo ~ J )Z 

2 z 4 

= lim — r =2 m 

z ^oo 

Proceeding as before, we can obtain 

[X(z) - 3z 3 - 2z 2 ] 


and 


x(—T) = lim 

z —^ oo 


= lim 

z—>oo 


2 z 4 + z 3 - 2z 2 - z + 4 

z 2 - 1 


— 2z" 


2z 4 + z 3 — 2z 2 — z + 4 — 2z 4 + 2z 2 

= lim --- 

z^oo (z 2 - l)z 

z 3 — z + 4 

= lim —r-= 1 ■ 

z^oo (z z — 1 )Z 


r(0) = lim [X(z) - 3z 3 - 2z 2 - z] 


= lim 

z—>oo 


= lim 

z—>oo 


= lim 

z—>oo 


r z 3 - z + 4 
(z 2 - 1 ) 
r z 3 - z + 4 - z 3 + z 


(z 2 - 1) 


(z 2 - 1) 


= 0 
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3.8.5 Use of Partial Fractions 

If the degree of the numerator polynomial in X(z) is equal to or less than the degree of the denominator 
polynomial, the inverse of X(z) can very quickly be obtained through the use of partial fractions. 
Two techniques are available, as detailed next. 

Technique I: The function X(z)/z can be expanded into partial fractions as 



where P is the number of poles in X(z) and 


Rq = lim X(z) Rj — Dle.v 



Hence 



(3.35) 


and 


x(nT ) = Z 



Now from Table 3.2, we get 


p 


x(nT) = RpSjnT) + ^ u(nT)Rjp" 


Technique II: An alternative approach is to expand Xiz.) into partial fractions as 


p 


p. 



(3.36) 


where 


Rq = lim X(z) 


Ri = mes X(z) 


and P is the number of poles in X(z. ) as before. Thus 
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and, therefore, Table 3.2 gives 


p 


X(nT ) = R 0 S(nT) + u(nT - 


Note that in a partial-fraction expansion, complex-conjugate poles give complex-conjugate 
residues. Consequently, one need only evaluate one residue for each pair of complex-conjugate poles. 
Note also that if the numerator degree in X(z) is equal to the denominator degree, then the constant 
R 0 must be present in Eqs. (3.35) and (3.36). If the numerator degree exceeds the denominators 
degree, one could perform long division until a remainder is obtained in which the numerator degree 
is equal to or less than the numerator degree as was done in Sec. 3.8.3. The inversion can then be 
completed by expanding the remainder function into partial fractions. 

It should be mentioned here that the partial-fraction method just described is very similar to 
the general inversion method of Sec. 3.8 in that both methods are actually techniques for obtaining 
Laurent series, the difference being that the general inversion method yields a Laurent series for 
X(z)z n ~ 1 whereas the partial-fraction method yields a Laurent series of X(z.). However, there is a 
subtle difference between the two: The general inversion method is complete in itself whereas in the 
partial-fraction method it is assumed that the inverse z transforms of 


z - Pi z - Pi 


are known. 



Using the partial-fraction method, find the inverse z transforms of 


(b) 


(a) 



■ Solution 


(a) On expanding X(z.)/z into partial fractions as in Eq. (3.35), we get 


X(z) 1 



Z Z 2 + Z + 5 


where 


e i 3?r/4 


g —7371-/4 


Pl= Vf 


and p 2 = 
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Thus we obtain 


R i = 9ies 

z=pi 


[*(z)l 


and 

Ri = d\es 

[X(z)l 

= — j 

z 



Z=P2 

z 


= J 


i.e., complex-conjugate poles give complex-conjugate residues, and so Eq. (3.37) gives 


*(z)=^+ 72 


Z - Pi Z - P2 


From Table 3.2, we now obtain 


x{nT) = u(nT)( - jp\ + jp 2 ) 


1 


= (i) n/ u(nT)j [ e ji7ln ' A - e - j3nn/A ) 


= 2 


' 1 \»/2 


u(nT) sin 


3 Tin 


Alternatively, we can expand X{z.) into partial fractions using Eq. (3.36) as shown in 
part ( b ). 


(. b) X(z) can be expressed as 

X(z) = 


where 


(*~k) 


TY = Ro 


R i 


Ri 


(3.38) 


Rq — lim X(z) = lim 


00 “ *- 00 (z - \) (z - I) 


= lim - = 0 

z^-oo 1 


R\ = 9\es X(z) = -pr 

z= j — 4 ) 


R 2 = 9ies X(z) = -pr 

*4 (Z-D 


= 2 


t 

z = 2 


= -1 


Hence Eq. (3.38) gives 


2 -1 

X(z) — -f H-f 
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and from Table 3.2 


x(nT) = 4u(nT - T) (±)" 



And something to avoid. Given a z transform X(z), one could represent the residues by vari¬ 
ables, then generate a number of equations, and after that solve them for the residues. For example, 
given the z transform 


X(z) = 


z 2 — 2 

(z - l)(z - 2) 


(3.39) 


one could write 


* i Ri 

X(z) = *o + ~r + ~ 

z - 1 z - 2 

Riz - 2 Ri + R 2 z - *2 + Rq(z - l)(z - 2) 

~~ (z - l)(z - 2 ) 

Riz - 2R\ + R 2 z - R 2 + Ro(z 2 - 3z + 2) 

(z- D(z-2) 

Riz — 2R\ + R 2 z — R 2 + Roz^ — 3Rqz + 2Ro 
= (z - l)(z - 2 ) 

Roz 2 + (Ri + R 2 — 3/?o)z — 2R\ — R 2 + 2Rq 
_ (z - l)(z - 2 ) ( ' 

One could then equate coefficients of equal powers of z in Eqs. (3.39) and (3.40) to obtain 

z 2 : Ro = 1 

z 1 : -3fl 0 + *i + *2 = 0 

z° : 2*o - 2*i - * 2 = -2 (3.41) 

Solving this system of equations would give the correct solution as 

* 0 =1 *, = 1 * 2 = 2 


For a z transform with six poles, a set of six simultaneous equations with six unknowns would need 
to be solved. Obviously, this is a very inefficient method, and it should definitely be avoided. The 
quick solution for this example is easily obtained by evaluating the residues individually, as follows: 


*o = 


z 2 -2 


(z - l)(z - 2) 


= 1 


*i = 


(z — 2) 


= 1 


Ri = 


z 2 — 2 


z=l 


(z- 1) 


= 2 


z=2 



















3.9 SPECTRAL REPRESENTATION 
OF DISCRETE-TIME SIGNALS 
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This section examines the application of the z transform as a tool for the spectral representation of 
discrete-time signals. 

3.9.1 Frequency Spectrum 

A spectral representation for a discrete-time signal x(n T) can be obtained by evaluating its z transform 
X(z) at z = e jaT , that is, by letting 


X(z)\ z=eJ „ T = X(e^ T ) 

Evidently, this substitution will give a function of the frequency variable w, which turns out to be 
complex. The magnitude and angle of X(e jnlT ), that is, 

A{to) = \X(e ja,T )\ and </>(«) = arg X(e jcoT ) 

define the amplitude spectrum and phase spectrum of the discrete-time signal x(n T), respectively, 
and the two together define the frequency spectrum. 

The exponential function e J " ,T is a complex number of magnitude 1 and angle coT and as o> is 
increased from zero to 2 jt/ T, e J0,T will trace a circle of radius 1 in the z plane, which is referred to as 
the unit circle. Thus evaluating the frequency spectrum of a discrete-time signal at some frequency 
a) amounts to evaluating X(z) at some point on the unit circle, say, point B. in Fig. 3.8. 

Some geometrical features of the z plane are of significant practical interest. For example, 
zero frequency, that is, co = 0, corresponds to the point z — e ,v " 7 U = o = e° = 1, that is, point A in 



Figure 3.8 Evaluation of frequency spectrum of a discrete-time signal. 
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Fig. 3.8; half the sampling frequency, i.e., u> s /2 = Jt/T, which is known as the Nyquist frequency, 
corresponds to the point z = \ a) =jz/r = f /7r = — 1, that is, point C; and the sampling frequency 
corresponds to the point z = e'" >r \a>= 2 n/T = c /2 ' T = 1, that is, point A, which is also the location for 
zero frequency. 

The frequency spectrum of a discrete-time signal can be determined very quickly through the 
use of MATLAB, the author’s DSP software package D-Filter, or other similar software. 

3.9.2 Periodicity of Frequency Spectrum 

If frequency u> is changed to co + kco s where k is an integer, then 

e j(a>+kio s )T _ e j(u>T+2kn) _ £ joiT _ e j2kn 

= e^ T (cos2kit + j sin2k7r) 

= e JwT 


Thus 


X(z) 


?—g / (a)+ka)s ) T 


— X{z)\ z=eimT 


or 


X^Hco+kcos) r } = X {e imT ) 


i.e., the frequency spectrum of a discrete-time signal is a periodic function offrequency with period co s . 
This actually explains why the sampling frequency corresponds to the same point as zero frequency 
in the z plane, namely, point A in Fig. 3.8. The frequency range between —co s /2 and co s /2 is often 
referred to as the baseband. 

To consolidate these ideas, let us obtain spectral representations for the discrete-time signals 
that can be generated from the continuous-time signals of Examples 2.5 and 2.10 through the sampling 
process. 


Example 3.10 


The pulse signal of Example 2.5 (see Fig. 2.6 a) is sampled using a sampling 
frequency of 100 rad/s to obtain a corresponding discrete-time signal x(n T). Find the frequency 
spectrum of x(nT ) assuming that r = 0.5 s. 


> Solution 

The sampling period is 


2n 2ir 

T = -— =-= 0.062832 s 

w, 100 


Hence from Fig. 2.6 a, we note that there are 


“(?) 


— = int 


0.5 


0.062832 


= 7 
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Time domain 



Time, s 
(a) 


Amplitude spectrum 



Frequency, rad/s 


Phase spectrum 



Frequency, rad/s 


C b ) 


(c) 


Figure 3.9 Frequency spectrum of discrete-time pulse signal (Example 3.10): 
(a) Discrete-time pulse, ( b ) amplitude spectrum, (c) phase spectrum. 


samples in the range — r/2 to r/2, as illustrated in Fig. 3.9 a. Thus the required discrete¬ 
time signal can be expressed as 


x(nT) = 


1 for — 3 < n < 3 

0 otherwise 
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From the definition of the z transform, we get 

oo 3 

X(Z) = J2 x(nT)z~ n = z~ n 

n =-oo n =-3 


The frequency spectrum of the signal is obtained as 

X(e Jt,yr ) = 1 + (e ]ar + e- j(oT ) + ( e j2coT + e~ j2o>T ) + (e jiwT + e~ j3oiT ) 
= 1+2 cos coT + 2 cos 2toT + 2 cos 3coT m 

Hence the amplitude and phase spectrums of x(nT) are given by 

A(o>) = 11 + 2 cos coT + 2 cos 2coT + 2 cos 3coT \ m 


and 


0 

—jr 


if X(e jaT ) > 0 

otherwise 


0(a>) = 

respectively. Their plots are depicted in Fig. 3.9 b and c. 


Example 3.11 


The z transform of the discrete-time signal 


x(nT) = u(nT)e anT sina>onT 


(see Example 2.10) where a and a>o are positive constants and 

u(nT ) = < ^ 


for n > 0 
for n < 0 


is the discrete-time unit-step function can be obtained as 

ze~ aT sincuoT 


X(z) = 


z 2 — 2ze~ aT cos coqT + e~ 2aT 
(see Table 3.2). Deduce the frequency spectrum. 


■ Solution 

The given z transform can be expressed as 
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where 


ci\ = e aT sincwo?’ 

7 —2 aT 

bo = e 


b\ = —2e aT cosa>oT 


The frequency spectrum of x(nT) can be obtained by evaluating X(z) at z = e J ' l,T , 
that is, 


X(e jaT ) = 


a\e 


jroT 


e j2coT + b ie jioT + bo 


a\e 


jcoT 


cos 2 coT + j sin 2 coT + b\ cos coT + jb\ sin coT + bo 


aie 


JioT 


bo + bi coscoT +cos2 coT + j(b\ sin coT + sin2a>7’) 


where 


A(co) = 


|flil-k y '" r l 


\(bo + b\ cos coT + cos 2coT) + j(bi sin coT + sin2o>7’)| 

_jail_ 

a /(bo + bi cos coT + cos 2 u>T) 2 + ( b\ sin coT + sin 2 caT) 2 

_jail_ u 

i/l + bl + b\ + 2b \(1 + bo) cos coT + 2bo cos 2 coT 


(See Eq. (A.32b).) Since T > 0, we have 


4>(co) = arg(£q) + arg e JcoT 
= argtq + coT — tan 


— arg[£>o + b i cos coT + cos 2 a>T + j(b\ sin wT + sin 2 coT)] 

, sincuT + sin2&>T 

- ■ 

bo + b\ cos coT + cos 2 coT 


where 


/ ° 

argai = < 


if > 0 
otherwise 


(See Eq. (A.32c).) The amplitude and phase spectrums of the discrete-time signal are 
illustrated in Fig. 3.10 for the case where a = 0.4 and coq = 2.0 rad/s assuming a 
sampling frequency oo s — 2:r/T = 10 rad/s. 
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Amplitude spectrum 



Frequency, rad/s 
(a) 


Phase spectrum 



Frequency, rad/s 

C b ) 


Figure 3.10 Frequency spectrum of discrete-time decaying sinusoidal signal (Example 3.1 1, 
a = 0.4, a> 0 — 2.0 rad/s, and a> s = 10 rad/s): (a) Amplitude spectrum, (b) phase spectrum. 


The amplitude and phase spectrums of the discrete-time decaying sinusoidal signal of 
Example 3.11 over the frequency range —3^/2 to 3a> s /2 with co s = 20 rad/s are depicted in 
Fig. 3.11. As expected, the frequency spectrum is periodic with period a> s = 20 rad/s. 


3.9.3 Interrelations 

In the two examples presented in the preceding section, we have examined discrete-time signals that 
were obtained by sampling the continuous-time signals in Examples 2.5 and 2.10. If we compare 
the frequency spectrums of the discrete-time signals with those of the corresponding continuous¬ 
time signals (i.e.. Fig. 2.1a and b with Fig. 3.9 b and c and Fig. 2.11 b and c with Fig. 3.10 a and b), 
we note a strong resemblance between the two. Since the former are derived from the latter, it is 
reasonable to expect that some mathematical relation must exist between the two sets of spectrums. 
Such a relation does, indeed, exist but it depends critically on the frequency content of the continuous¬ 
time signal relative to the sampling frequency. If the highest frequency present in the signal is less than 
the Nyquist frequency (i.e., ca s /2), then the spectrum of the discrete-time signal over the baseband is 
exactly equal to that of the continuous-time signal times 1/ T, where T is the sampling period. Under 
these circumstances, the continuous-time signal can be recovered completely from the corresponding 
discrete-time signal by simply removing all frequency components outside the baseband and then 
multiplying by T. 
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Amplitude spectrum 



(a) 



-30 -20 -10 0 10 20 30 

Frequency, rad/s 

(b) 


Figure 3.11 Frequency spectrum of discrete-time decaying sinusoidal signal (Example 3.11, a = 0.4, 
a>o = 2.0 rad/s, a> s — 20 rad/s): (a) Amplitude spectrum, (b) phase spectrum. 

The above discussion can be encapsulated in a neat theorem, known as the sampling theorem, 
which states that a continuous-time signal whose frequency spectrum comprises frequencies that are 
less than half the sampling frequency (or, alternatively, a continuous-time signal which is sampled 
at a rate that is higher than two times the highest frequency present in the signal) can be completely 
recovered from its sampled version. The sampling theorem is obviously of crucial importance because 
if it is satisfied, then we can sample our signals to obtain corresponding discrete-time signals without 
incurring loss of information. The discrete-time signals can then be transmitted or archived using 
digital hardware. Since no loss of information is involved, the original continuous-signal can be 
recovered at any time. One can go one step further and process the discrete-time signal using a 
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DSP system. Converting such a processed discrete-time into a continuous-time signal will yield a 
processed continuous-time signal, and in this way the processing of continuous-time signals can be 
achieved by means of DSP systems. 

If the sampling theorem is only approximately satisfied, for example, if there are some low- 
level components whose frequencies exceed the Nyquist frequency, then the relation between the 
spectrum of the continuous-time signal and that of the discrete-time signal becomes approximate 
and as more and more components have frequencies that exceed the Nyquist frequency, the relation 
becomes more and more tenuous and eventually it breaks down. 

It follows from the above discussion that the sampling theorem and the spectral relationships 
that exist between continuous- and discrete-time signals are of considerable importance. They will, 
therefore, be examined in much more detail later on in Chap. 6. 

REFERENCE 

[ 1 ] E. I. Jury, Theory and Application of the z-Transform Method , New York: Wiley, 1964. 


PROBLEMS 


3.1. Construct the zero-pole plots of the following functions, showing the order of the zero or pole where 
applicable: 

( «) = 

(» Y(d = fe2 + 4)2 


(c) Y(z) = 


(z + l) 4 

z 2 + 2z+ 1 
z 2 T jZf | 


3.2. Construct the zero-pole plots of the following functions, showing the order of the zero or pole where 
applicable: 

(a) X(z) — z 2 + z _1 

z 7 + 1 

(b) X(z) = 


(z 2 + l) 3 


(C) X(z) = 


1 


z 3 + 6z 2 + llz + 6 
3.3. Construct the zero-pole plots of the following functions: 

-5 


(a) X(z) = 

(b) X(z) = 

(c) X(z) = 


7TZ 

nz + 1 

z(z + 1) 

z 2 - 1.3z + 0.42 
216z 2 + 162z + 29 


(2z + l)(12z 2 + 7z+ 1) 

3.4. Construct the zero-pole plots of the following functions: 

(a) X(z) = 4z“ 3 + 3z“ 2 + 2z" 3 + z“ 4 + z“ 5 
z 6 + 2z 2 


(b) X(z) = 


(c) Y(z) = 


(z 4 + 3z 2 + 1) 

3z + 2 — 2z _1 - 2z“ 2 - z" 3 - 4z -4 
l-|z-2+iz- 4 
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3.5. 

3.6. 

3.7. 


3.8. 


3.9. 


(o) Prove that the z transform is a linear operation. 

(b) Repeat part (a) for the inverse z transform. 

(a) Obtain the real-convolution integral of Eq. (3.15) from the complex convolution given in Eq. (3.14b). 

( b ) Derive Parseval’s discrete-time formula in Eq. (3.16) starting with the complex-convolution formula 
given in Eq. (3.14b). 

For each of the following functions, obtain all Laurent series with center z = 0. Show the region of 
convergence and identify which series is a z transform in each case: 

(a) X(z) = —^ 

1 - z 2 

1 •<.)>' each of the following functions, obtain all Laurent series with center z = 0. Show the region of 
convergence and identify which series is a z transform in each case: 

4z - 1 

(«) X(z) = --- 

z 4 - 1 

,u\ vr \ Z 2 + 2z + 1 

(b) X(z) = -- , ,, 

(z- l)(z+ 

For each of the following functions, obtain all Laurent series with center z = 0. Show the region of 
convergence and identify which series is a z transform in each case: 

4z 2 + 2z — 4 

(«) X(z) = 


(b) X(z) = 


(z 2 + l)(z 2 - 4) 
7z 2 + 9z— 18 
z 3 — 9z 


3.10. 


3.11. 


3.12. 


3.13. 


3.14. 


For each of the following functions, obtain all Laurent series with center z = 0. Show the region of 
convergence and identify which series is a z transform in each case: 

4z 2 + 1 

{b) X{Z) (z 2 - l)(z 2 -2)(z 2 + 3) 

Find the z transforms of the following functions: 

(a) u(nT)(2 + 3e~ 2nT ) 

(b) u(nT)-S(nT ) 

(c) [u(nT)e"r(nT - T) 

Find the z transforms of the following functions: 

(a) u(nT)[l + (—l)"]e~" T 

(b) u(nT) sinh otnT 

(c) u(nT) sin (amr + 1 ^) 

( 1 d ) u(nT) cosh otnT 

Find the z transforms of the following functions: 

(a) u(nT)nTw" 

(b) u(nT)(nT) 2 

(c) u(nT)(nTj i 

0 d) u(nT)nTe~ 4nT 

Find the z transforms of the following discrete-time signals: 

1 for 0 S n < k 


(a) x(nT) 


u 


otherwise 
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nT 

0 


for 0 < n < 5 
otherwise 


(a) x(nT) = 


(b) x{nT) : 

3.15. Find the z transforms of the following discrete-time signals: 
for n < 0 
for 0 < n < 5 
for 5 < n < 10 
for n > 10 

for n < 0 
for 0 < n < 5 

(n - 5 )T for 5 < n < 10 
(n-lO)r for u < 10 
transforms of the following discrete-time signals: 


(. b ) x(nT) 

3.16. Find the z 

(a) x(nT) = 

(b) x(nT) = 


for n < 0 
for 0 < n < 9 
for 10 < n < 19 
for n > 20 
forn < —3 
for — 2 < n < 1 
for 1 < n < 5 
for n > 6 


3.17. Find the z transforms of the following discrete-time signals: 
(a) x(nT) - 


(. b) x(nT) = 

3.18. Find the z 

(a) x(nT) 

(. b ) x{nT) = 



for n < 0 
for 2 + nT 
for n < —2 
for — 2 < n < — 1 
for n > 0 

transforms of the following discrete-time signals: 

= u(nT)nT(l + e~ anT ) 

0 for n < 0 ( 1 

e -anT Note that In-— 

for n > 0 \ 1 - 




3.19. By using the real-convolution theorem (Theorem 3.7), obtain the z transforms of the following: 

(a) x(nT) = J2l=o r ( nT ~ kT)u(kT) 

(b) x(nT) = J2" k =o^nT - kT)u(kT)e~ akT 

3.20. Prove that 


2 V x(kT) = —-— Zx{nT) 

^' 7—1 

k =0 


3.21. Find /(0) and /(oo) for the following z transforms: 

2z - 1 
(a) X(z) = -- 


(b) X(z) = 


( e~ aT - 1 )z 

z 2 - (1 + e~ 0,T )z + e~ aT 
Tze~ 4T 
(z - e~ 4T ) 2 


(c) X(z) = 
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3.22. Find the z transforms of the following: 

(a) y(nT) = J2?=o a i x ( nT ~ iT ) 

C b ) y(«r) = - jT)- xifei ^y(nr -*7’) 

3.23. Form the z transform of 


x(nT) = [u(nT) - «(«r - Air)]W in 


3.24. Find the z transforms of the following: 

(a) x{nT) = u(nT) cos 2 a>nT 

(a) x(nT) = u(nT) sin 4 conT 

3.25. Find the z transforms of the following by using the complex-convolution theorem (Theorem 3.10): 

(a) x{nT) = u(nT)e~ anT sin (amT + i/r) 

(b) x(nT) = r(nT) sm(conT + i/r) 

(c) x(nT) = r(nT)e- anT cos (conT + f) 

3.26. Find the inverse z transforms of the following: 

2 ... ... . 5 


(a) X(z) = 


(c) X(z) = 


2z- 1 

3z 


(b) X(z) = 


z - e~ 


(d) X(z) = 


2z 


3z + 2 

3.27. Find the inverse z transforms of the following: 


z 2 -2z+ 1 


(a) X{z) = 


(c) X{z) = 


z + 2 


z(z + 1) 

(z - DU 2 + 1) 


(b) X(z) = 
id) X(z) = 


z 3 + 2z 

(z+ l)(z 2 + 1) 


3.28. 


Find the inverse z transforms of the following by using the long-division method for n < 0 and the general 
inversion method for n >0 method: 

, , . 216z 3 + 96z 2 + 24z + 2 

(a) X(z) = 


(b) X(z) = 


(c) X(z) = 


12z 2 + 9z + 18 
3z 4 - z 3 - z 2 


z - 1 

3z 5 + 2z 4 - 2z 3 - 2z 2 - z + 4 
z 2 - 1 


3.29. 

3.30. 

3.31. 


3.32. 


Find the inverse z transforms in Prob. 3.28 by using the initial-value theorem (Theorem 3.8) for n < 0 
and the partial-fraction method for n > 0 method. 

Find the inverse z transforms of the following by using the general inversion method: 

{a) X(z) = ( b ) X{z) = 2 2Z ' 

Find the inverse z transforms of the following by using the general inversion method: 

<«) x & = 

\ Z 5 / 

(b) * (Z) = 0 2.9 —n 

( 2z l + 2z + l)(3z — 1) 

Find the inverse z transforms of the following by using the partial-fraction method: 

(z — l) 2 ... . 4z 3 


(a) X(z) = 


z 2 — O.lz — 0.56 


(b) X(z) = 


(2z + l)(2z 2 - 2z + 1) 
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3.33. Find the inverse ; transforms of the following by using the real-convolution theorem (Theorem 3.7): 


(a) X(z) = 


z 2 - 2z + 1 


(b) X(z) = 


3.34. Find the inverse ; transform of 


X(z) = 


(z - e- T )(z - 1) 

;(; + 1 ) 


(z - l) 3 

3.35. Find the inverse z transform of the following by means of long division: 

w , ;(; 2 + 4z + 1) 

* b>= b-D* 

3.36. (a) Derive expressions for the amplitude and phase spectrums of the signal represented by the z transform 


X(z) = 


z 2 — z+\ 
z 2 - \z + \ 


(b) Calculate that amplitude and phase spectrums at a> = 0, cus/4, and a> s / 2. 

(c) Using MATLAB or a similar software package compute and plot the amplitude and phase spectrums. 
3.37. Repeat parts ( a ) and (b) of Prob. 3.36, for the following z transform 


X(z) = 0.086 


(z 2 - 1.58;+ 1) 


z 2 - 1.77;+ 0.81 

3.38. Repeat parts ( a ) and ( b ) of Prob. 3.36, for the following ; transform 

(12; 3 + 6.4; 2 + 0.68;) 


X(z) = 


(; + 0.1)(; 2 +0.8;+ 0.15) 


3.39. The ; transform of a signal is given by 


*(z) = 


; + fli; + a 0 


z 2 + biz + b 0 

(a) Show that the amplitude spectrum of the signal is given by 

\f \ + Uq + a\ + 2ai(l + 2flo)cosa>r + 2 flo cos 2a>T 


X(jcb) = 


\/l + bl + b\ + 2^+1 + 2b 0 )cosa>T + 2 b 0 cos2a>T 


(b) Obtain an expression for the phase spectrum. 













CHAPTER 

4 


DISCRETE-TIME 

SYSTEMS 


4.1 INTRODUCTION 

Digital-signal processing is carried out by using discrete-time systems. Various types of discrete-time 
systems have emerged since the invention of the digital computer such as digital control, robotic, and 
image-processing systems. Discrete-time systems that are designed to perform filtering are almost 
always referred to as digital filters, and a variety of digital filters have evolved over the years as 
detailed in Chap. 1. 

A discrete-time system is characterized by a rule of correspondence that describes the rela¬ 
tionship of the output signal produced with respect to the signal applied at the input of the system. 
Depending on the rule of correspondence, a discrete-time system can be linear or nonlinear, time 
invariant or time dependent, and causal or noncausal. 

Discrete-time systems are built from a small set of basic constituent discrete-time elements 
that can perform certain elementary operations like addition and multiplication. By interconnecting a 
number of these basic elements, discrete-time networks can be formed that can be used to implement 
some fairly sophisticated discrete-time systems. 

Two types of processes can be applied to discrete-time systems, analysis and design. Analysis 
can be used to deduce a mathematical representation for a discrete-time system or to find the output 
signal produced by a given input signal. Design, on the other hand, is the process of obtaining through 
the use of mathematical principles a discrete-time system that would produce a desired output signal 
when a specified signal is applied at the input. 

This chapter deals with the analysis of discrete-time systems. First, the fundamental concepts 
of linearity, time invariance, and causality as applied to discrete-time systems are discussed and 
tests are provided that would enable one to ascertain the properties of a given system from its 
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rule of correspondence. The representation of these systems in terms of networks and signal flow 
graphs is then examined and analysis methods are presented that can be used to derive mathematical 
representations for discrete-time systems in the form of difference equations. Next, an elementary 
analysis method based on a mathematical induction technique is presented that can be used to find the 
time-domain response of a discrete-time system to a given input signal. An alternative representation 
of discrete-time systems known as the state-space representation follows, which provides alternative 
methods of analysis and design. The chapter concludes with an introduction to the concept of stability 
and outlines a basic test that can be used to establish whether a discrete-time system is stable or not. 

The design of discrete-time systems that can perform DSP, e.g., digital filters, will form the 
subject matter of several chapters, starting with Chap. 8. 

4.2 BASIC SYSTEM PROPERTIES 

A discrete-time system can be represented by the block diagram of Fig. 4.1. Input x(nT ) and output 
y(nT) are the excitation and response of the system, respectively. The response is related to the 
excitation by some rule of correspondence. We can indicate this fact notationally as 

y(nT) = lZx(nT) 


where 1Z is an operator. 

Depending on its rule of correspondence, a discrete-time system can be classified as linear or 
nonlinear, time invariant or time dependent, and causal or noncausal [1], 

4.2.1 Linearity 

A discrete-time system is linear if and only if it satisfies the conditions 

lZax(nT) = alZx(nT) (4.1a) 

lZ[x\(nT) + X 2 (nT)] = lZx\(nT) + TZx^inT) (4.1b) 


x(nT) O 


Discrete-time system 


-O y(nT) 




Figure 4.1 Discrete-time system. 
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for all possible values of a and all possible excitations xi(n T) and.t^Cn'O. The condition inEq. (4.1a) 
is referred to as the proportionality or homogeneity condition and that in Eq. (4.1b) as the superpo¬ 
sition or additivity condition [1]. 

On applying first the superposition condition and then the proportionality condition, the re¬ 
sponse of a linear discrete-time system to an excitation olx\ inT) + fixiinT), where a and /i are 
arbitrary constants, can be expressed as 


y(tiT ) = lZ[axi(nT) + (5x2 (nT)] — lZax\(nT) + TZPxjinT) 
= a1Zx\(nT) + piZx 2 {nT) 


Thus, the two conditions in Eqs. (4.1a) and (4.1b) can be combined into one, namely. 


!Z[axi(nT) + fixiinT)] = alZxiQiT) + /31Zx2(nT) 


(4.1c) 


If this condition is violated for any pair of excitations or any constant a or /6, then the system is 
nonlinear. 

The use of Eq. (4.1c) to check the linearity of a system tends to involve quite a bit of writing. A 
simpler approach that works well in a case where the system appears to be nonlinear is to first check 
whether the proportionality condition in Eq. (4.1a) is violated. If it is violated, then the work is done 
and the system can be classified as nonlinear. Otherwise, the superposition condition in Eq. (4.1b) 
must also be checked. Telltale signs of nonlinearity are terms like \x(nT)\ or x k (nT) in the rule of 
correspondence. 

If the proportionality and superposition conditions hold for arbitrary excitations and arbitrary 
constants a and ft, then the system is linear. 



(i a ) The response of a discrete-time system is of the form 


y(nT) = !Zx(nT) = 1 x 2 (jiT - T) 


Check the system for linearity. ( b ) Repeat part (a) if 


y{nT) = Kx(nT) = (nTfxiiiT + 2 T) 


■ Solution 


(a) A delayed version of the input signal appears squared in the characterization of the 
system and the proportionality condition is most likely violated. For an arbitrary constant 
a, we have 


IZaxinT) = la 1 x 1 (nT — T ) 


On the other hand. 


alZx(nT) = lax 2 (tiT — T) 
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Clearly if a ^ 1, then 

lZax(nT) ^ alZx(nT) 

that is, the proportionality condition is violated and, therefore, the system is non¬ 
linear. ■ 

( b ) For this case, the proportionality condition is not violated, as can be easily verified, and 
so we should use Eq. (4.1c), which combines both the proportionality and superposition 
rules. We can write 

lZ[ax\(nT) + /3x2(nT)] = (iiT) 2 [ax\{nT + 2 T) + /3x2(nT + 2 T)] 

= a(nT) 2 x\(nT + 2 T) + P(nTfx 2 (nT + 2 T) 

= allx\(jiT) + piZx 2 {nT) 

that is, the system is linear. ■ 

The squared term ( nT) 2 may trick a few but it does not affect the linearity of the 
system since it is a time-dependent system parameter which is independent of the input 
signal. 


4.2.2 Time Invariance 

A discrete-time system is said to be time invariant if its response to an arbitrary excitation does not 
depend on the time of application of the excitation. The response of systems in general depends on 
a number of internal system parameters. In time-invariant systems, these parameters do not change 
with time. 

Before we describe a test that can be used to check a discrete-time system for time invariance, 
the notion of a relaxed system needs to be explained. Systems in general have internal storage or 
memory elements that can store signal values. Such elements can serve as sources of internal signals 
and, consequently, a nonzero response may be produced even if the excitation is zero. If all the 
memory elements of a discrete-time system are empty or their contents are set to zero, the system is 
said to be relaxed. The response of such a system is zero for all n if the excitation is zero for all n. 

Formally, an initially relaxed discrete-time system with excitation x(nT) and response y(nT), 
such that x(nT ) = y{nT) = 0 for n < 0, is said to be time-invariant if and only if 

7 Zx{nT - kT) = yinT - kT) (4.2) 

for all possible excitations x(nT ) and all integers k. In other words, in a time-invariant discrete-time 
system, the response produced if the excitation x(n T ) is delayed by a period k'k is numerically equal 
to the original response y(nT) delayed by the same period kT. This must be the case, if the internal 
parameters of the system do not change with time. The behavior of a time-invariant discrete-time 
system is illustrated in Fig. 4.2. As can be seen, the response of the system to the delayed excitation 
shown in Fig. 4.2 b is equal to the response shown in Fig. 4.2a delayed by kT. 

A discrete-time system that does not satisfy the condition in Eq. (4.2) is said to be time 
dependent. 
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Figure 4.2 Time invariance: (a) Response to an excitation x(nT), ( b ) response to a delayed excitation 
x{nT — kT). 


Example 4.2 


(a) A discrete-time system is characterized by the equation 
y(jiT ) = !Zx(nT) = 2nTx(nT) 

Check the system for time invariance. ( b) Repeat part (a) if 

y(nT) = Kx(nT) = 12 x{nT — T) + 11 x(nT - 2 T) 


■ Solution 

(a) The response to a delayed excitation is 

lZx(nT — kT) = 2nTx(nT — kT) 

The delayed response is 

y(nT - kT) = 2(nT - kT)x(nT - kT) 

Clearly, for any k ^ 0 

TZx(nT - kT) / y(nT - kT) 
and, therefore, the system is time dependent. ■ 
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(, b ) In this case 

7 Zx(nT - kT ) = V2x[(n - k)T -T] + 11 x[{n - k)T - 2 T] 

= y(nT -kT) 

for all possible x(nT ) and all integers k, and so the system is time invariant. ■ 


In practical terms, one would first replace nT by nT — kT in each and every occurrence of 
x(nT ) in the characterization of the system to obtain the response produced by a delayed excitation. 
Then one would replace each and every occurrence of nT by nT — kT to obtain the delayed response. 
If the same expression is obtained in both cases, the system is time invariant. Otherwise, it is time 
dependent. 

4.2.3 Causality 

A discrete-time system is said to be causal if its response at a specific instant is independent of 
subsequent values of the excitation. More precisely, an initially relaxed discrete-time system in 
which x(nT) = y(nT) = 0 for n < 0 is said to be causal if and only if 

TZx\(nT) = IZxi(nT) for n < k (4.3a) 

for all possible distinct excitations x\(nT) and xainT), such that 

xi(nT) — X 2 (nT) for n < k (4.3b) 


Conversely, if 


lZx\(nT) ^ TZx 2 (nT) for n < k 

for at least one pair of distinct excitations x\{nT) and X 2 (nT) such that 

x\{nT) — X 2 (nT) for n < k 

for at least one value of k, then the system is noncausal. 

The above causality test can be easily justified. If all possible pairs of excitations x\{nT) and 
X 2 (nT) that satisfy Eq. (4.3b) produce responses that are equal at instants nT < kT, then the system 
response must depend only on values of the excitation at instants prior to nT, where xj (nT) and 
X 2 (nT) are specified to be equal, and the system is causal. This possibility is illustrated in Fig. 4.3. 
On the other hand, if at least two distinct excitations x\{nT) and X 2 (nT) that satisfy Eq. (4.3b) 
produce responses that are not equal at any instant nT < kT, then the system response must depend 
on values of the excitation at instants subsequent to nT, since the differences between x\(nT) and 
X 2 (nT) occur after nT, and the system is noncausal. 
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Figure 4.3 Causality: (a) Response to xi(nT), ( b ) response to xi(nT). 


Example 4.3 


(a) A discrete-time system is represented by 


y(nT) = Hx(nT) = 3x («7 - 27) + 3x(nT + 27) 


Check the system for causality. ( b) Repeat part (a) if 

y(nT) = TLxfnT) = 3x(nT - 7) - 3x(nT - 27) 


■ Solution 

(i a ) Let x\{nT) and xnJnT) be distinct excitations that satisfy Eq. (4.3b) and assume that 
x\(nT) ^ X 2 (nT) for n > k 

For n — k 


lZxi(nT)\ n=k = 3x\{kT — 27) + 3x\{kT + 27) 

TZx2(nT)\ n=k = 3x2(kT — 27) + 3x2(kT + 27) 

and since we have assumed that x\(jiT) ^ X 2 (nT ) forn > k, it follows that x\{kT + 
27) ^ X 2 ikT + 27) and thus 


3x\(kT + 27) / 3x 2 ikT + 27) 
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Therefore, 


lZx\{nT) ^ 1Zx 2 (nT) 

for n = k 

that is, the system is noncausal. ■ 

( b ) For this case 


TZx\{nT) — 3x\(nT — 7) 

- 3xi in 7 - 27) 

Kx 2 (nT) = 3x 2 (nT - 7) 

- 3x 2 (n7 - 27) 

If n < k , then n — 1, n — 2 < k and so 


x\{nT — 7) = x 2 (nT — 7) and 

x\(nT — 27) = x 2 (nT — 27) 

for n < k or 


!Zx\(nT) — lZx 2 (nT) 

for n < k 

that is, the system is causal. ■ 



Noncausality is often recognized by the appearance of one or more terms such as x(n 7 + |k| 7) 
in the characterization of the system. In such a case, all one would need to do is to find just one 
pair of distinct signals that satisfy Eq. (4.3b) but violate Eq. (4.3a) for just one value of n, as was 
done in Example 4.3(a). However, to demonstrate causality one would need to show that Eq. (4.3a) 
is satisfied for all possible distinct signals that satisfy Eq. (4.3b) for all possible values of n < k. 
Demonstrating that Eq. (4.3a) is satisfied for just one value of n, say, k, is not sufficient. 

Note that the presence of one or more terms like x(n 7 + \k\T) in the system equation is neither 
a necessary nor a sufficient condition for causality. This point is illustrated by the following example. 


Example 4.4 


A discrete-time system is characterized by the following equation 
y(nT + 27) = e nT + 5x(/i7 + 27) 

Check the system for (a) linearity, (b) time invariance, and (c) causality. 

■ Solution 


By letting n = n' — 2 and then replacing n! by n, the system equation can be expressed 
as 

y(nT) = Kx{nT) = e (n ~ 2)T + 5x(«7) 
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(a) We note that 

K[ax(nT)] = e (n ~ 2)T + 5 ax(nT) 

On the other hand. 


allx(nT) = a[e {n ~ 2)T + 5 x(nT)] = ae (n ~ 2)T + 5ax(nT + 2 T) 

For a 7 ^ 1, we have e ( "~ 2)/ ^ ae (n ~ 2)T and hence 

TZ[ax(nT)] ^ alZx(nT) 

Therefore, the proportionality condition is violated and the system is nonlinear. ■ 

( b) The response to a delayed excitation is 

TZx(nT - kT) = e (n ~ 2)T + 5 x(nT - kT) 

The delayed response is 

y(nT - kT) = e nT ~ 2T ~ kT + 5 x (nT - kT) 

For any k ^ 0, we have e^'~ 2)T ^ e nT-2T-kT anc j [ lence 


y(nT - kT) + Hx(nT - kT) 


Therefore, the system is time dependent. ■ 

(c) Let x\(nT) and xjinT) be two arbitrary distinct excitations that satisfy Eq. (4.3b). 
The responses produced by the two signals are given by 

Kx^nT) = e (n - 2)T + 5 Xl (nT) 

Hx 2 (nT) = e (n ~ 2)T + 5x 2 {nT) 


and since 


jci (nT) — x 2 (nT) for n < k 


we have 


TZx\(iiT) = lZx 2 (nT) for n < k 

that is, the condition for causality is satisfied and, therefore, the system is causal. ■ 


Discrete-time systems come in all shapes and forms. Systems that operate as digital filters 
are almost always linear although there are some highly specialized types of digital filters that are 
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basically nonlinear. Most of the time, nonlinearity manifests itself as an imperfection that needs to 
be eliminated or circumvented. 

In continuous-time systems, nine times out of ten, time dependence is an undesirable imperfec¬ 
tion brought about by drifting component values that needs to be obviated. However, in discrete-time 
systems it turns out to be a most valuable property. Through the use of time dependence, adaptive 
systems such as adaptive filters can be built whose behavior can be changed or optimized online. 

Causality is a prerequisite property for real-time systems because the present output cannot 
depend on future values of the input, which are not available. However, in nonreal-time applications 
no such problem is encountered as the numerical values of the signal to be processed are typically 
stored in a computer memory or mass storage device and are, therefore, readily accessible at any 
time during the processing. Knowledge of causality is important from another point of view. Certain 
design methods for digital filters, for example, those in Chaps. 9 and 15, yield noncausal designs and 
for a real-time application, the designer must know how to convert the noncausal filter obtained to a 
causal one. 

4.3 CHARACTERIZATION OF DISCRETE-TIME SYSTEMS 

Continuous-time systems are characterized in terms of differential equations. Discrete-time systems, 
on the other hand, are characterized in terms of difference equations. Two types of discrete-time 
systems can be identified: nonrecursive and recursive. 

4.3.1 Nonrecursive Systems 

In a nonrecursive discrete-time system, the output at any instant depends on a set of values of 
the input. In the most general case, the response of such a system at instant nT is a function of 
x(nT — MT ),..., x(nT), ..., x(nT + KT), that is, 

y(nT) = f{x{nT - MT), ..., x(nT),..., x(nT + KT)} 

where M and K are positive integers. If we assume linearity and time invariance, y(nT) can be 
expressed as 

M 

y(nT) = E aixiriT — iT) (4.4) 

i=-K 

where a, for i = — K , (— K + 1),..., M are constants. If instant nT were taken to be the present, 
then the present response would depend on the past M values, the present value, and the future K 
values of the excitation. Equation (4.4) is a linear difference equation with constant coefficients of 
order M + K, and the system represented by this equation is said to be of the same order. 

If K > 0 inEq. (4.4), then y(nT) would depend on x(nT + T), x{nT + 27),..., x(nT + KT) 
and, obviously, the deference equation would represent a noncausal system but if K = 0, the 
representation of an Mth-order causal system would be obtained. 

4.3.2 Recursive Systems 

A recursive discrete-time system is a system whose output at any instant depends on a set of values 
of the input as well as a set of values of the output. The response of a fairly general recursive, linear. 
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time-invariant, discrete-time system is given by 

M N 

y(nT) = ajx(nT — iT) — bjyinT — iT) (4.5) 

i=-K i= 1 

that is, if instant n T were taken to be the present, then the present response would be a function of 
the past M values, the present value, and the future K values of the excitation as well as the past N 
values of the response. The dependence of the response on a number of past values of the response 
implies that a recursive discrete-time system must involve feedback from the output to the input. The 
order of a recursive discrete-time system is the same as the order of its difference equation, as in a 
nonrecursive system, and it is the larger of M + K and N + K. The difference equation in Eq. (4.5) 
for the case where K = M — N — 2 is illustrated in Fig. 4.4. 



Figure 4.4 Graphical representation of recursive difference equation. 
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Note that Eq. (4.5) simplifies to Eq. (4.4) if b ,■ = 0 for 1, 2,..., N, and essentially the 
nonrecursive discrete-time system is a special case of the recursive one. 


4.4 DISCRETE-TIME SYSTEM NETWORKS 

The basic elements of discrete-time systems are the adder , the multiplier, and the unit delay. The 
characterizations and symbols for these elements are given in Table 4.1. Ideally, the adder produces 
the sum of its inputs and the multiplier multiplies its input by a constant instantaneously. The unit 
delay, on the other hand, is a memory element that can store just one number. At instant nT, in 
response to a synchronizing clock pulse, it delivers its content to the output and then updates its 
content with the present input. The device freezes in this state until the next clock pulse. In effect, 
on the clock pulse, the unit delay delivers its previous input to the output. 

The basic discrete-time elements can be implemented in analog or digital form and many 
digital configurations are possible depending on the design methodology, the number system, and the 
type of arithmetic used. Although analog discrete-time elements may be used in certain specialized 
applications, for example, for the implementation of neural networks, discrete-time systems that 
are used for DSP are almost always digital and, therefore, the adder, multiplier, and unit delay are 
digital circuits. A practical approach would be to implement adders and multipliers through the use 
of parallel combinational circuits and unit delays through the use of delay flip-flops. 1 Under ideal 


Table 4.1 Elements of discrete-time systems 


Element 


Symbol 


Equation 

Unit delay 

x{nT) o- 


T 


-o y(nT) 

y(nT) = x(nT—T) 


Adder 



K 

y{nT) = 'LxjinT) 
1=1 


m 


Multiplier 


x(nT) o 


■o y(nT) 


y(nT) = mx(nT ) 


x Also known as D flip-flops. 
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conditions, the various devices produce their outputs instantaneously, as mentioned above, but in 
practice the three types of devices introduce a small delay known as the propagation delay due to 
the fact that electrical signals take a certain amount of time to propagate from the input to the output 
of the device. 

Collections of unit delays, adders, and multipliers can be interconnected to form discrete-time 
networks. 

4.4.1 Network Analysis 

The analysis of a discrete-time network, which is the process of deriving the difference equation 
characterizing the network, can be carried out by using the element equations given in Table 4.1. 
Network analysis can often be simplified by using the shift operator £ r which is defined by 

£ r x(nT ) = x(yiT + rT) 

The shift operator is one of the basic operators of numerical analysis which will advance or delay a 
signal depending on whether r is positive or negative. Its main properties are as follows: 

1. Since 

£' [a\X\(iiT) + a 2 X 2 (nT)] — a\X\(nT + rT) + a 2 Xi{nT + rT) 

= a\£ r xfnT) + a 2 £' X 2 (nT) 

we conclude that £ r is a linear operator which distributes with respect to a sum of functions of 
nT. 

2. Since 

£' £ p x(nT) = £ r x(jiT + pT) — x(nT + rT + pT) 

= £ r+p x(nT) 

the shift operator obeys the usual law of exponents. 

3. If X 2 (nT) = £ r xfnT) then £~ r X 2 (nT) = x\(nT) for all x\{nT), and if xfnT) — £~ r X 2 (nT) 
then X 2 (nT) = £ r X\ (nT) for all x^inT). Therefore, £~ r is the inverse of £ r and vice versa, that 
is, 

£~ r £ r = £ r £~ r = 1 

4. A linear combination of powers of £ defines a meaningful operator, e.g., if 

/ (£) = 1 + a\£ + a 2 £~ 


then 


f(£)x(nT) = (1 + a\£ + a 2 £ 2 )x(nT) 


= x{nT) + a\x{nT + T) + c /2 x(nT + 2 T) 
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Further, given an operator f(£) of the above type, an inverse operator f(£) 1 may be defined 
such that 


f(£)~ l x(£) = x(£)f{£)~ 1 = 1 


5. If f\ (£), / 2 (f), and f:\{£) are operators that comprise linear combinations of powers of £, then 
they satisfy the distributive, commutative , and associative laws of algebra, that is, 

M£)[fi(£) + h(£)] = f\(£)h{£) + M£)f 3 (£) 

M£)fi(£) = fi(£)M£) 
fi(£)[f 2 (£)M£)] = lf\(£)f2(£)]M£) 


The above operators can be used to construct more complicated operators of the form 


F{£) = M£)M£)~ l = f 2 (£)~ 1 M£) 


which may also be expressed as 


F{£) = 


M£) 

fi{£) 


without danger of ambiguity. 


Owing to the above properties, the shift operator can be treated like an ordinary algebraic 
quantity [ 2 ], and operators that are linear combinations of powers of £ can be treated as polynomials 
which can even be factorized. For example, the difference equation of a recursive system given in 
Eq. (4.5) can be expressed as 


y(nT) = [ y a,£ 1 ) x(nT) - [ y^fr,-£ ' ) y{nT) 


\i=—K 


\ i= 1 


and, therefore, the recursive system can represented in terms of operator notation as 

y{nT) = IZx(nT) (4.6) 


where 1Z is an operator given by 


n = 


( E \ 

V' + e; v =, b,£-‘J 


The application of the above principles in the analysis of discrete-time networks is illustrated 
in Example 4.5(1?) below. 
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x(nT) 



py(nT—T) 




y(nT) 


(b) 



Figure 4.5 Discrete-time networks (Example 4.5): (a) First-order system, ( b ) implementation of first-order 
system, (c) second-order system. 


Example 4.5 


Fig. 4.5c. 


(a) Analyze the network of Fig. 4.5 a. (b) Repeat part ( a ) for the network of 


■ Solution 

(a) From Fig. 4.5 a, the signals at nodes A and B are y(nT — T) and py(nT — T), 
respectively. Thus, 


y(nT) = x(nT ) + py(nT — T) 


( 4 . 7 ) 
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(b) From Fig. 4.5c, we obtain 

v\(nT) — m\x(nT) + m^inT) + m^v-i(nT) 

VjinT) — £~ l V\(nT ) u 3 (nT) — £~ 1 y(nT) 

y(nT) — rri 2 V 2 (nT) + m^v^ifiT) 

and on eliminating 112 (nT) and u 3 (nT) in v\(nT) and y(nT), we have 

(1 — m 3 £~ 1 )tii(«7’) = m\x(nT) + m$£~ l y(nT) (4.8) 

and 

(1 — m^£~ l )y(nT) — m 2 £~ l V\(nT) (4.9) 

On multiplying both sides of Eq. (4.9) by (1 — m 3 £ _1 ), we get 

(1 — m 3 £ -1 )( 1 — m^£~ l )y(nT) = (1 — m 3 £~ I )m2£~ 1 i>i(«7’) 

= m2£~ l (l — m2,£~ l )v\{iiT) 

and on eliminating (1 — m 3 £ _1 )i>i(n7’) using Eq. (4.8), we have 

[1 — (m 3 + m£)£~ l + m-im^£~ 2 \y{nT) — m\m 2 £~ l x(nT) + m 2 ms£~ 2 y(nT) 
Therefore, 

y(nT) = a\x(nT — T) + b\y(uT — T) + biy(nT — 2 T) m 

where 

a\ = fflj /112 b\ = m 3 + m .4 and b 2 — m 2 m 5 ~ m 3 W 4 


4.4.2 Implementation of Discrete-Time Systems 

The mode of operation of discrete-time systems depends on the implementation of their constituent 
elements. A relatively simple paradigm to explain is the case whereby adders and multipliers are 
built as parallel combinational digital circuits, and the unit delays are constructed using delay flip- 
flops. If the discrete-time system in Fig. 4.5 a were implemented according to this paradigm and the 
signals and coefficients were assumed to be represented, say, by 4-bit signed binary digits, then an 
implementation of the type shown in Fig. 4.5 b would be obtained where the unit delay is an array 
of four clocked D flip-flops and Rp is a read-only register in which the digits of coefficient p are 
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stored. Let us assume that the adder, multiplier, and unit delay have propagation delays x A ,x M , and 
Xud , respectively. 

At a sampling instant nT, a very brief clock pulse triggers the unit delay to deliver its content 
y(nT — T) to its output and the content of the unit delay is replaced by the current value of y(n T) in 
Tud s. The output of the unit delay will cause the correct product pyinT — T) to appear at the output 
of the multiplier in x M s. This product will cause a new sum x(nT ) + py{nT — T ) to appear at input 
of the unit delay and at the output of the system in x A s. By that time, the clock pulse would have 
disappeared and the unit delay would be in a dormant state with the previous system output recorded 
in its memory and the present output at the input of the unit delay. Obviously, this scheme will work 
out in practice only if the outputs of the unit delay, multiplier, and adder reach steady state before 
the next clock pulse which will occur at the next sampling instant. This implies that the sampling 
period T must be long enough to ensure that T > x M + x A . Otherwise, the unit delay will record an 
erroneous value for the output of the adder. 

The system in Fig. 4.5c would operate in much the same way. Just before a sampling instant, 
signals are deemed to be in steady state throughout the system. When a clock pulse is received 
simultaneously by the two unit delays, the unit delays output their contents and their inputs overwrite 
their contents after a certain propagation delay. The outputs of the unit delays then propagate through 
the multipliers and adders and after as certain propagation delay, new numerical values appear at the 
inputs of the unit delays but by then, in the absence of a clock pulse, the unit delays will be dormant. 
We note that there are signal paths between the output of each unit delay and its input, between the 
output of the left and the input of the right unit delay, and between the output of the right and the 
input of the left unit delay. We note also that each of these signal paths involves a multiplier in series 
with an adder and thus the sampling period should be long enough to ensure that T > x m + x a , as in 
the first-order system of Fig. 4.5a. 

This simple analysis has shown that the propagation delays of the multipliers and adders impose 
a lower limit on the sampling period T which translates into an upper limit on the sampling frequency 
f s = 1 /T\ consequently, high sampling frequencies can be used only if fast hardware with short 
propagation delays is available, as may be expected. 

4.4.3 Signal Flow-Graph Analysis 

Given a discrete-time network, a corresponding topologically equivalent signal flow graph can be 
readily deduced by marking and labeling all the nodes of the network on a blank sheet of paper and 
then replacing 

• Each adder by a node with one outgoing branch and as many incoming branches as there are 
inputs to the adder 

• Each distribution node by a distribution node 

• Each multiplier by a directed branch with transmittance equal to the constant of the multiplier 

• Each direct transmission path by a directed branch with transmittance equal to unity 

• Each unit delay by a directed branch with transmittance equal to the shift operator S ~ 1 . 

For example, the signal flow graph of the network shown in Fig. 4.6a can be drawn by marking 
nodes A, C, F, G, H, D, and E on a sheet of paper and then replacing unit-delays, adders, multipliers, 
and signal paths by the appropriate nodes and branches, as depicted in Fig. 4.6 b. 
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(b) 


Figure 4.6 (a) Discrete-time network, ( b ) signal flow graph. 


As can be seen in Fig. 4.6 b, signal flow graphs provide a compact and easy-to-draw graphical 
representation for discrete-time networks and can, in addition, be used to analyze networks through 
the use of some well-established signal flow-graph methods [3-5]. Two signal flow-graph methods 
that are readily applicable for the analysis of discrete-time networks are the node-elimination method 
and Mason’s method. 

NODE ELIMINATION METHOD. In the node elimination method, the given signal flow graph is 
reduced down to a single branch between the input and output nodes through a sequence of node 
eliminations [5] and simplifications, and the transmittance of the last remaining branch is the operator 
of the network. From the functional relationship provided by this simplified signal flow graph, the 
difference equation of the network can be readily deduced. 

Node elimination can be accomplished by applying a small set of rules, as follows: 

Rule 1: K branches in series with transmittances T\, 'A,..., T K can be replaced by a single branch 
with transmittance T\ A ... Tk, as shown in Fig. 4.7 a. 
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Figure 4.7 Node elimination rules: (a) Rule 1, ( b ) Rule 2, (c) Rule 3, ( d ) Rule 4a, (e) Rule 4b. 


Rule 2: branches in parallel with transmittances 1 \, 7 2 . ..., T K can be replaced by a single branch 
with transmittance 7\ + T 2 + • • • + T K , as illustrated in Fig. 4.1b. 

Rule 3: A node with N incoming branches with transmittances T n , T i2 , ...,T in and M outgo¬ 
ing branches with transmittances 7 qi, T 0 2 , ■ ■ ■, Tom can be replaced by N x M branches with 
transmittances Ti\Tq\, T f \ Tqi, ..., Ti^Tqm as illustrated in Fig. 4.7c. 
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Rule 4a: K self-loops at a given node with transmittances 77, 77,..., T K can be replaced by a single 
self-loop with transmittance 77 + 77 + ■ ■ ■ + Tk , as illustrated in Fig. 4.1 d. 

Rule 4b: A self-loop at a given node with transmittance T$l can be eliminated by dividing the 
transmittance of each and every incoming branch by 1 — T$l as shown in Fig. 4.7 e. 

Actually, Rule 4 a is a special case of Rule 2 since a self-loop is, in effect, a branch that starts 
from and ends on one and the same node. 

The above rules constitute a graphical way of doing algebra and, therefore, their validity can be 
readily demonstrated by showing that the equations of the simplified flow graph can be obtained from 
those of the original flow graph. For example, the equations of the bottom flow graph in Fig. 4.7e 
are given by 


M 
<) = 


Tn 

1 -t sl 


h + 


TmoM 


T, 2 

1 - Tsl 


h 


and can be obtained from the equations of the top flow graph in Fig. 4.7e, that is. 


M = 7/i /i + 772/2 + T$lM 
O = TmqM 


by moving the term T/cM in the first equation to the left-hand side and then dividing both sides by 
the factor 1 — Tsl■ 


Example 4.6 


Find the difference equation of the discrete-time network shown in Fig. 4.6 a 
by using the node elimination method. 


■ Solution 

Eliminating node H in Fig. 4.6 b using Rule 3 yields the signal flow graph of Fig. 4.8a 
and on combining parallel branches by using Rule 2, the graph of Fig. 4.8T> can be 
deduced. Applying Rule 3 to node G in Fig. 4.8 b yields the graph in Fig. 4.8c which can 
be simplified to the graph in Fig. 4.8<7 by combining the parallel branches. 

Applying Rule 3 to node F in Fig. 4.8<7 yields the graph of Fig. 4.8e and on combining 
the parallel branches and then eliminating node C, the graph Fig. 4.8/ can be obtained. 
In Fig. 4.8/, we note that there is a self-loop at node B and on using Rule 4b the graph 
of Fig. 4.8 g is deduced, which can be simplified to the graph of Fig. 4.8 h using Rule 1. 
Hence, 



y(nT) = 


1 — 77 


x(nT) 


(4.10) 
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G 

(a) 



(b) 



F 


(c) 



F 


(d) 

Figure 4.8 Signal flow graph reduction method (Example 4.6): (a) Elimination of node H, 
( b ) combining of parallel branches, (c) Elimination of node G, ( d ) combining of parallel 
branches. 
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A 1 B 1 C a 0 DIE 



-b^'-bi £- 2 -b 3 £- 3 a t £-' + a^+ a,r 3 

(e) 

A 1 B 7 D 1 E 



( 8 ) 

T \ 

i-r 2 

x(nT ) •--• y(nT ) 

w 

Figure 4.8 Cont’d ( e ) elimination of node F, (/) combining of parallel branches and 

elimination of node C, (g) elimination of self-loop and node D, (h) combining of series branches. 


or 


Therefore, 


and since 


and 


we obtain 


(1 - T 2 )y(nT) = Tix(nT) 


y{nT) = T\x{nT) + T 2 y{nT) 

T\ = ao + a\E~ x + g 2 £~~ + a 3 £~ 3 

T 2 =-[b^- 1 + b 2 £~ 2 + b 3 £~ 3 ] 


(4.11) 


(4.12) 


(4.13) 


(4.14) 


y(nT ) = ciox(nT) + a\x(nT — T) + a 2 x(nT — 2 T) + a 3 x(nT — 3 T) 
- b\y(nT - T) - b 2 y(nT - 27) - b 3 y{nT - 37) ■ 
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o 





o 


Figure 4.9 (a) Avoidance of node elimination errors. 

The amount of work required to simplify a signal flow graph tends to depend on the order in 
which nodes are eliminated. It turns out that the required effort is reduced if at any one time one 
eliminates the node that would result in the smallest number of new paths. The number of new paths 
for a given node is equal to the number of incoming branches times the number of outgoing branches. 

The most likely source of errors in signal flow graph simplification is the omission of one or 
more of the new paths generated by Rule 3. This problem can be circumvented to a large extent by 
drawing strokes on the branches involved as each new path is identified. At the end of the elimination 
process, each incoming branch should have as many strokes as there are outgoing branches and 
each outgoing branch should have as many strokes as there are incoming branches, as illustrated in 
Fig. 4.9. If the strokes do not tally, then the appropriate node elimination needs to be checked. 

MASON’S METHOD. An alternative signal flow-graph analysis method is one based on the so- 
called Mason’s gain formula [5, 6]. If i and j are arbitrary nodes in a signal flow graph representing 
a discrete-time network, then the response at node j produced by an excitation applied at node i is 
given by Mason’s gain formula as 



(4.15) 
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Parameter T k is the transmittance of the k\h direct path between nodes i and j, A is the determinant 
of the flow graph, and A k is the determinant of the subgraph that does not touch (has no nodes or 
branches in common with) the Aith direct path between nodes i and j. 

The graph determinant A is given by 

A = 1 — L u i + P v 2 — P w 3 + • • • 

U V W 

where L u \ is the loop transmittance of the nth loop, P v2 is the product of the loop transmittances of 
the nth pair of nontouching loops (loops that have neither nodes nor branches in common), P w 3 is 
the product of loop transmittances of the u;th triplet of nontouching loops, and so on. 

The subgraph determinant A* can be determined by applying the formula for A to the subgraph 
that does not touch the kth direct path between nodes i and j . 

The derivation of Mason’s formula can be found in [ 6 ]. Its application is illustrated by the 
following example. 


Example 4.7 


Analyze the discrete-time network of Fig. 4.6a using Mason’s method. 


■ Solution 


From Fig. 4.6 b, the direct paths of the flow graph are ABCDE, ABCFDE, ABCFGDE, 
and ABCFGHDE and hence 


T\ = cig Ti — a\£ 1 Z3 = a 2 £ 2 Tn — a 2 £ 3 
The loops of the graph are BCFB, BCFGB, and BCFGHB and hence 
Lu = — b\£ 1 L21 = — b 2 £ 2 T31 = — 3 

All loops are touching since branch BC is common to all of them, and so 

Pv 2 = Pw 3 = • • • = 0 


Hence 


A = 1 + b x £~ x + b 2 £~ 2 + b 3 £~ 3 

The determinants of the subgraphs A*, k = 1, 2, 3, and 4, can similarly be determined 
by identifying each subgraph that does not touch the A’th direct path. As can be seen 
in Fig. 4.6 b, branch BC is common to all direct paths between input and output and, 
therefore, it does not appear in any of the subgraphs. Consequently, no loops are present 
in the k subgraphs and so 


A1 = A2 = A3 = A4 = 1 
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Using Mason’s formula given by Eq. (4.15), we obtain 


or 


y{nT) = 


( E;=()«;£ ' \ 
V 1 + ELi he-*) 


x(nT) 


y(nT) = 



x(nT) — 


5 ~2 b i £ ' y ( nT ) ■ 


4.5 INTRODUCTION TO TIME-DOMAIN ANALYSIS 

The time-domain response of simple discrete-time systems can be determined by solving the differ¬ 
ence equation directly using mathematical induction. Although this approach is somewhat primitive, 
it demonstrates the mode by which discrete-time systems operate. The approach needs nothing more 
sophisticated than basic algebra as illustrated by the following examples. 


Example 4.8 


(a) Find the impulse response of the system in Fig. 4.5a. The system is initially 
relaxed, that is, y{nT) — 0 for n < 0, and p is a real constant, (b) Find the unit-step response 
of the system. 


■ Solution 


(a) From Example 4.5(a), the system is characterized by the difference equation 

y(nT) = x(nT) + py(nT — T) (4.16) 

With x(nT ) = S(nT), we can write 

y(0) = l + py(-T)=l 
y(T) = 0 + py( 0) = p 
y(2T) = 0 + py(T) = p 2 


y(nT ) = p" 

and since y(nT) = 0 for n < 0, we have 

y(nT) = u(nT)p n m (4.17) 
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y(nT) 


p< 1 


nT 





Figure 4.10 Impulse response of first-order system (Example 4.8(a)). 


The impulse response is plotted in Fig. 4.10 for p < 1, p = 1, and p > 1. We note that 
the impulse response diverges if p > 1. 

( b ) With x{nT) — u(nT), we get 

y(0) = 1 + py(-T) = 1 
y(T) = 1 + py( 0) = 1 + p 
y(2T) = 1 + py(T) = 1 +p + p 2 


y(nT) = u(nT)^p k 

k=0 
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This is a geometric series with common ratio p and hence we can write 
y(nT) - pyinT) = u(nT){\ - p {n+1) ) 


or 


1 - p (n+1) 

y(nT) = u(nT) --- ■ (4.18) 

1 - p 


For p < 1, —> 0 and hence the steady-state value of the response is 

obtained as 


1 

lim y(nT) = - 

n—too ’ 1 — p 



nT 




Figure 4.11 Unit-step response of first-order system (Example 4.8(£>)). 
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For p = 1, Eq. (4.18) gives y(nT) = 0/0 but if we apply I' Hopital's rule, we obtain 


y(nT) = lim 

p-5-l 


d( 1 - p ( ' l+l) )/dp 
d( 1 — p)/dp 


= n + 1 


Thus y(nT) -a- oo as n —> oo. 
For p > 1, Eq. (4.18) gives 


lim y(nT) - > oo 

n ► oo p — 1 


The unit-step response for the three values of p is illustrated in Fig. 4.11. Evidently, the 
response converges if p < 1 and diverges if p > 1. 


Example 4.9 


(a) Find the response of the system in Fig. 4.5a to the exponential excitation 


x(nT) = u(nT)e janr 


( b ) Repeat part (a) for the sinusoidal excitation 

x(nT ) = u(nT)smcL>nT 


(c) Assuming that p < 1, find the response of the system to the sinusoidal excitation in 

part ( b ) as n —> oo. 


■ Solution 


(a) With the system initially relaxed, the use of Eq. (4.16) gives 

y(0) = e ° + py(-T)= 1 

y(T) = e j0>T + py(0) = e ja)T + p 

y(2T) = e j2coT + py(T) = e j2olT + pe jaT + p 2 


y{nT) = u(nT)(e j0lnT + pe ],o{n - V)T + • • • + p {n - (a) (b) (c) * * * * * * * * l) e jojT + p n ) 

= u(nT)e j0,nT ( 1 + pe- ia>T + ■ ■ ■ + p n e~ jna>T) ) 

= u(nT)e j0,nT t p k e ~j k( ° T 
k =0 
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This is a geometric series with a common ratio pe 1 " ,T and, as in Example 4.8(7?), the 
above sum can be obtained in closed form as 


y(nT ) = u(nT) 


e jamT _ p(n+\) e ~joiT 

1 — pe~ lu,T 


Now consider the function 


H(e ]0/r ) = 


1 

1 — pe~J mT 


e jcoT 

ei mT — p 


and let 


H(e jcoT ) = M(m)e ma) 


where 


and 


M(co) = \H(e ju,T )\ 


1 

yj 1 T /? 2 — 2p coscoT 


(4.19) 


(4.20) 


(4.21) 


(4.22a) 


6(co) = arg H(e ju,T ) = coT - tan -1 


sin coT 
cos coT — p 


(4.22b) 


as can be easily shown. On using Eqs. (4.19)—(4.21), y(nT) can be expressed as 


y(nT) = u(nT)H(e Jo,T )(e jmlT - p (n+l) e~ iaT ) 

= u(nT)M(co)(e m ‘ o)+olnT] - / /"+V [e(<u) - a,r] ) ■ (4.23) 


(. b ) The system is linear and so 

y(nT) = lZu(nT) sinconT = Ku(nT)—(e jo,nT - e ~ ju,nT ) 

2 j 

= —[1lu(nT)e iconT - Hu(nT)e- janT ] 

2 j 

= ^[yi (nT)-y 2 (nT)] (4.24) 

2 J 

where 


y^nT) = Hu(nT)e ju,nT and y 2 (nT) ='Ru(nT)e~ ianT 
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Partial response y\{riT) can be immediately obtained from Eq. (4.23) in part ( a ) as 

yi(nT) = u(nT)M(co)(e ma>)+<onT] - p (n+1) e jie (")-" r l) (4.25) 

and since 

y 2 {nT)=1lu{nT)e ja>nT \ (o ^_ m (4.26) 

partial response y 2 {nT ) can be obtained by replacing co by — co in y\{nT), that is, 

y 2 (nT ) = u{nT)M(-m){e m - a) - mT] - e m - a)+coT] ) (4.27) 

From Eqs. (4.22a) and (4.22b), we note that M{co) is an even function and ()((») is an 
odd function of co, that is, 

M(—co) = M(co) and 0(—co) = —6(co) 

Hence Eqs. (4.24), (4.25), and (4.27) yield 

y(nT) = h(«T)—( e J[9M+ “ n - e -f [e( “)+“" 7 ’1) 

2 j 

- u{n T)^^p^\ e i^-^ - e ~ mM) -“ r] ) 

2j 

= u(nT)M(a>) sin [ftinE + 0(cu)] 

-n(«r)M(w)p> (n+1) sin[0(ft.)-wr] ■ (4.28) 

We note that the response of the system consists of two components. For a given frequency 
co, the first term is a steady sinusoid of fixed amplitude and the second term is a transient 
component whose amplitude is proportional to /; (, ' +l) . 

(c) If p < 1, then the transient term in Eq. (4.28) reduces to zero as n —> oo since 
lim^oo //" +l) —> 0 and, therefore, we have 

y(nT ) = lim y(nT) — M(co)sin[conT + 6{oo)] ■ 

n —>• oo 

This is called the steady-state sinusoidal response and, as can be seen, it is a sinusoid of 
amplitude M(co) displaced by a phase angle 0(o>). Since the input is a sinusoid whose 
amplitude and phase angle are unity and zero, respectively, the system has introduced a 
gain M(co) and a phase shift 6(co), as illustrated in Fig. 4.12. 
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Figure 4.12 Steady-state sinusoidal response of first-order system (Example 4.9 b). 


The sinusoidal response in the above example turned out to comprise a steady-state and a 
transient component. This is a property of discrete-time systems in general, as will be demonstrated 
in Chap. 5. Functions M(o>) and 9{(d), which will resurface in Sec. 5.5.1, facilitate one to find the 
steady-state sinusoidal response of a system for any specified frequency <x> and by virtue of linearity 
one can also find the response produced by a signal that comprises an arbitrary linear combination 
of sinusoids of different frequencies. Obviously, these are very useful functions and are called the 
amplitude response and phase response of the system, respectively. 

If p were greater than unity in the above example, then the amplitude of the transient com¬ 
ponent would, in principle, increase indefinitely since p <ll+l ' —> oo in such a case. Lack of 

convergence in the time-domain response is undesirable in practice and when it can occur for at least 
one excitation, the system is said to be unstable. On the basis of the results obtained in Examples 4.8 
and 4.9, the system in Fig. 4.5a is unstable if p > 1 since the unit-step response does not converge 
for p > 1. The system appears to be stable if p < 1 since the impulse, unit-step, and sinusoidal 
responses converge for this case but, at this point, we cannot be certain whether an excitation exists 
that would produce an unbounded time-domain response. The circumstances and conditions that 
must be satisfied to assure the stability of a discrete-time system will be examined in Sec. 4.7. 
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The above time-domain analysis method can be easily extended to higher-order systems. 
Consider, for example, the general system represented by Eq. (4.6). Assuming that N > M, then 
through some simple algebra one can express Eq. (4.6) in the form 


y(nT) = 


R n 




Ri 


+ Pi£ 1 


x(nT) 


(4.29) 


where and R, are constants, possibly complex. This equation characterizes the equivalent parallel 
configuration of Fig. 4.13a where H, is a first-order system characterized by 


y(nT) = 


Ri 

1 + pi£~ l 


x(nT ) 


The time-domain response of this first-order system can be obtained as in Examples 4.8 and 4.9 
and the response of the multiplier in Fig. 4.13a is simply Rox(nT). Therefore, by virtue of linearity, 
the response of the parallel configuration, and thus that of the original high-order system, can be 
deduced. For example, the impulse response of the first-order system in Fig. 4.13 b can be obtained 
as 


y(nT) = u{nT)Rip " 


(4.30) 


Ro 



Figure 4.13 Representation of a high-order system in terms of a set of first-order systems. 
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as in Example 4.8(a) and the impulse response of the multiplier is Rq8(}iT). Thus Eqs. (4.29) and 
(4.30) give the impulse response of an /V-order recursive system as 

^ R, 

= Rox(nT ) + V —- -—x(nT) 

^ 1 + piS- 1 

N 

= R 0 S(nT) + u(nT)J2 R iPi 

i=t 

The unit-step or sinusoidal response of the system can similarly be deduced. 

Unfortunately, the induction method just described can easily run into serious complications 
and lacks both generality and potential. An alternative approach that overcomes some of these 
difficulties is the state-space method described in Sec. 4.8. The most frequently used method for time- 
domain analysis, however, involves the use of the z transform and is described in detail in Chap. 5. 


4.6 CONVOLUTION SUMMATION 

The response of a discrete-time system to an arbitrary excitation can be expressed in terms of the 
impulse response of the system. 

An excitation x(nT) can be expressed as a sum of signals as 

OO 

x(nT) = x k (nT) (4.31) 

k=—o o 


where each signal x k (nT) has just one nonzero value equal to the value of x(nT ) at n — k, that is, 


x k (nT) = 


x(kT) 

0 


for n = k 
otherwise 


as illustrated in Fig. 4.14. Each of the signals x k {nT) is actually an impulse signal and can be 
represented as 


x k (nT) — x(kT)8(nT — kT) (4.32) 

and hence Eqs. (4.31) and (4.32) give 


OO 

x(nT)= ^2 x{kT)8{nT - kT) (4.33) 

k——oo 


Now consider a system characterized by the equation 

y(nT) = lZx(nT) 


(4.34) 
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x(nT) 



M nT ) 


40) 


+ 


nT 


x 2 (nT) 


x(T) 


x 3 (nT) 


42 T) 


+ 


nT 


nT 


Figure 4.14 Convolution summation: decomposition of a discrete-time signal into a sum of impulses. 


and let 


h(nT) = K8(nT) (4.35) 

be the impulse response of the system. Assuming that the system is linear and time invariant, 
Eqs. (4.33)—(4.35) give 


oo oo 

y(nT) — 1Z x(kT)8(nT — kT) — Y x(kT)TZ8(nT - kT) 

k =—oo k=—o o 

oo 

= Y x(kT)h(nT - kT) (4.36a) 

k=—oo 

This relation is of considerable importance in the characterization as well as analysis of discrete-time 
systems and is known as the convolution summation. 

Some special forms of the convolution summation are of particular interest. To start with, by 
letting n' = n — k in Eq. (4.36a) and noting that the limits of the summation do not change, the 
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alternative but equivalent form 


OO 

y(nT) = ^2 h(kT)x(nT — kT) (4.36b) 

k——oo 

can be obtained. If the system is causal, h(nT) — 0 for n < 0 and thus Eqs. (4.36a) and (4.36b) give 


ti oo 

y(nT) = E x(kT)h{nT - kT) = ^ h(kT)x(nT - kT) 

k =—oo k =0 


(4.36c) 


h(kT) 



x(kT) 


kT 


(b) 




Figure 4.15 Convolution summation: graphical representation. 
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and if, in addition, x(nT) = 0 for n < 0, then 


y(nT) = Y x(kT)h(nT - kT) = Y h ( kI "> x ( nT ~ kl "> (4.36d) 

k =0 k =0 


The convolution summation plays a critical role in the application of the z transform to discrete¬ 
time systems, as will be demonstrated in Chap. 5, and the assumptions made here in deriving the 
convolution summation, namely, that the system is linear and time invariant, become inherited 
assumptions for the applicability of the z transform to discrete-time systems. 


4.6.1 Graphical Interpretation 

The fist convolution summation in Eq. (4.36d) is illustrated in Fig. 4.15. The impulse response h{kT) 
is folded over with respect to the y axis, as in Fig. 4.15c, and is then shifted to the right by a time 
interval nT, as in Fig. 4.15c/, to yield h{nT — kT). Then xikT) is multiplied by h(nT — kT), as in 
Fig. 4.15e. The sum of all values in Fig. 4.15c is the response of the system at instant nT. 


Example 4.10 


(a) Using the convolution summation, find the unit-step response of the system 
in Fig. 4.5a. (b) Hence find the response to the excitation 


x(nT) = 


for 0 < n < 4 
otherwise 


■ Solution 


(a) From Example 4.8(a), the impulse response of the system is given by 


h(nT) = u(nT)p n 

(See Eq. (4.17).) Since the unit step is zero for n < 0, the convolution summation in 
Eq. (4.36a) gives 

OO 

y(nT) = !Zu(nT) = u(kT)p k u(nT — kT) 

k =—oo 


k =-1 k =0 k= 1 

/-^-x /-^-X /-^-X 

= ■■ ■ + u(-T)p~ l u(nT + T) + u(0)p°u(nT) + u(T)p l u(nT - T) 

k—n k=n +1 

/-^-X /- A -\ 

+ • • • + u(nT)p n u(0) + u(nT + T)p n+l u{—T) H— • 
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For n < 0, we get y(nT) — 0 since all the terms are zero. For n > 0, we obtain 


yinT) = 1 + p 1 + p 2 4-h p" = 1 + ^ p" 


This is a geometric series and has a sum 

1 - p (n+1) 

s = — r— 

i - p 

(see Eq. (A.46b)). Hence, the response can be expressed in closed form as 

1 - p {n+l) 

y(nT) = u{nT )——-- ■ 

1 - p 

(. b ) For this part, we observe that 

x(nT) = u(nT) — u(nT — 5T) (4.37) 


and so 


y(nT) = Kx(nT) = Ku(nT ) - Ku(nT - 5 T) (4.38) 


Thus 

1 - p ( ' !+1) 1 - p in ~V 

y(nT) = u(nT )--- u(nT - 57)--- 

1-/7 1-/7 

Alternatively, we can write 

1 - p (n+l) 

- for n < 4 

P 

_ „(«+!) 

- for n > 4 

- P 



Example 4.11 


An initially relaxed causal nonrecursive system was tested with an input 
x(nT) 

and found to have the response given by the following table: 


0 

n 


for n < 0 
for n > 0 


n 

0 

1 

2 

3 

4 

5 

6 

7 

yinT) 

0 

1 

4 

10 

20 

30 

40 

50 
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(a) Find the impulse response of the system for values of n over the range 0 < n < 5. 
(, b ) Using the result in part (a), find the unit-step response for 0 < n < 5. 


■ Solution 

(a) Problems of this type can be easily solved by using the convolution summation. Since 
the system is causal and x(nT) — 0 for n <0, the left-hand convolution summation in 
Eq. (4.36d) applies and hence 


y{nT) = Hx(nT) = ^x(kT)h(nT - kT) 
k =0 


or 


y(nT) = x(0)h(?iT) + x(T)h(nT — T) + • • • + h(0)x(nT) 
Evaluating y(nT) for n = 1, 2, ..., we get 

y(T) = x(0)h(T) + x(T)h(0) = 0 • h(T) + 1 • h(0) = 1 or h( 0) = 1 

y(2T) = x(0)h(2T) + x(T)h(T) + x(2T)h(0) 

= 0 ■ h(2T) + 1 • h(T) + 2 ■ h( 0) 

= 0 + h(T) + 2 = 4 or h(T) = 2 

y(3T) = x(0)h(3T) + x(T)h(2T) + x(2T)h(T) + x(3T)h(0) 

= 0 • h(3T) + 1 • h(2T) + 2 ■ h(T) + 3 ■ h{ 0) 

= h(2T) + 2-2 + 3-1 = 10 or h(2T) = 3 

y (AT) = x(0)h(4T) + x(T)h(3T) + x(2T)h(2T) + x(3 T)h(T) + jc(47’)/t(0) 
= 0 ■ h(4T) + 1 • h{3T) + 2 • h(2T) + 3 • h(T) + 4 ■ h( 0) 

= h(3T) + 2- 3 + 3- 2 + 4- 1 = 20 or h(3T) = 4 

y(5T) = x(0)h(5T) + x(T)h(4T) + x(2T)h(3T) + x(3T)h(2T) + x(4 T)h(T) 
+ x(5T)h(0) 

= 0 • h(5T) + 1 • h(4T) + 2 • h(3T) + 3 • h(2T) + 4 • h(T) + 5 • h( 0) 

= 0 + h(4T) + 2- 4+ 3- 3 + 4- 2 + 5- l = 30 


or 


h( 4 T) = 0 
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y(6T) = x(0)h(6T) + x(T)h(5T) + x(2T)h(4T) + x(3T)h(3T) + x(4T)h(2T) 

+ x(5T)h(T) + x(6T)h(0) 

= 0 ■ h(6T) + 1 ■ h(5T) + 2 ■ h(4T) + 3 ■ h(3T) + 4 ■ h(2T) + 5 ■ h(T) + 6 ■ h(0) 
= h(5T) + 2- 0+ 3- 4 + 4- 3 + 5- 2 + 6-1 
= 40 or h(5T) = 0 

Thus 

h( 0) = 1 h(T) = 2 h(2T) = 3 h(3T) = 4 

h(4T) = 0 h(5T) = 0 m 

(b ) Using the convolution summation again, we obtain the unit-step response as follows: 

n n 

y(nT) = Kx(nT) = ^ u(kT)h(nT - kT ) = ^hinT - kT) 
k =0 k=0 

Hence 

y(0) = h{ 0) = 1 

y(T) = h{T) + h(fl) = 2+1 = 3 
y(2T) = h(2T) + h(T) + h( 0) = 3 + 2 + 1 = 6 
y (3T) = h(3T) + h(2T) + h{T) + h{ 0) = 10 
y(4T) = h(4T) + h(3T) + h(2T) + h(T) + h{ 0) = 15 
y(5T) = h(5T) + h{4T) + h(3T) + h(2T) + h(T) + h( 0) = 21 

Thus 

y(0) — 1 y(T) = 3 y(2T) = 6 y(3T) = 10 

y(4T) = 15 y(5T) = 21 ■ 


4.6.2 Alternative Classification 

Discrete-time systems may also be classified on the basis of the duration of their impulse response 
either as finite-duration impulse response (FIR) systems or as infinite-duration impulse response 
(HR) systems. 2 


2 Actually, the acronyms for these systems should be FDIR and IDIR filters since it is the duration that is infinite and not 
the response. However, the acronyms FIR and IIR are too entrenched to be changed. 
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If the impulse response of a causal discrete-time system is of finite duration such that h (n T) — 0 
for n < — K and n > M, then the convolution summation in Eq. (4.36b) gives 

M 

y(nT) = h{kT)x(nT - kT) 

k=-K 

This equation is of the same form as Eq. (4.4) with = h(—K ), ci_k+\ — h{—K + 1).a M = 

h(MT) and, in effect, such a system is nonrecursive. Conversely, if a nonrecursive system is character¬ 
ized by Eq. (4.4), then its impulse response can be readily shown to be h(—K ) = a-K , h(—K + 1) = 
ci-K+ t, ■ ■ ■ ,h(MT) = a v/ and, therefore, it is of finite duration. 

In recursive systems, the impulse response is almost always of infinite duration but it can, in the¬ 
ory, be of finite duration, as will now be demonstrated. Consider a nonrecursive system characterized 
by the difference equation 


y(nT) = x(nT) + 3 x(nT - T) (4.39a) 

The impulse response of the system is obviously of finite duration since h(0) = 1, h(T) = 3, and 
h(kT) = 0 for all values of k ^ 0 or 1. If we premultiply both sides of Eq. (4.39a) by the operator 
(1 + 4£ _1 ), we get 


(1 + 4 £~ l )y(nT) = (1 + 4£~ l )[x(nT) + lx(iiT - D] (4.39b) 

and after simplification, we have 


y(nT) = x(nT ) + lx(nT - T) + Ux(nT - 2T) - 4 y(nT - T) 


Thus, an FIR system can be represented by a recursive difference equation! Evidently, the manipula¬ 
tion has increased the order of the difference equation from one to two but the system response will 
not change in any way. Under these circumstances, there is no particular reason in applying such a 
manipulation. In fact, there is every reason to identify common factors and cancel them out since 
they tend to increase the order of the difference equation and, in turn, the complexity of the system. 
On the other hand, an HR system cannot be nonrecursive and vice versa, as depicted in Fig. 4.16. 

An arbitrary recursive system can be represented by an equation of the form 


y(nT) = 


NjS- 1 ) 


x(nT ) 


and if operator polynomials N(£~ l ) and D(£ 1 ) are free from common factors, then the recursive 
system is also an HR system. Since common factors are a form of redundancy that must be removed, 
then, for all practical purposes, the terms recursive and HR are exchangeable and so are the terms 
nonrecursive and FIR. 

In this book, we shall be referring to systems as nonrecursive or recursive if the emphasis is 
on the difference equation or network and as FIR or HR if the emphasis is on the duration of the 
impulse response. 
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Nonrecursive Recursive 



Figure 4.16 Nonrecursive versus FIR and recursive versus HR systems. 


4.7 STABILITY 

A continuous- or discrete-time system is said to be stable if and only if any bounded excitation will 
result in a bounded response. In mathematical language, a discrete-time system is stable if and only 
if any input x(nT) such that 


\x(nT)\ < P < oo for all n (4.40) 

will produce an output y(nT) that satisfies the condition 

\y{nT)\ < Q < oo for all n (4.41) 

where P and Q are positive constants. 

For a linear and time-invariant system, the convolution summation in Eq. (4.36b) gives 


\y(nT)\ = 


OO 

Y h(kT)x(nT — kT) 

k ——oo 


oo 

< Y \h{kT)x{nT - kT)\ 

k =—oo 
oo 


< Y l /? (£r)| ■ I x(nT - kT )I (4.42) 

k =—oo 

The equal sign in the first equation is replaced by the less than or equal sign in the second and third 
equations since some of the terms under the sum may be negative and, consequently, the magnitude 
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of the sum may be smaller than the sum of the magnitudes, for example, |2-2 + 3- 3 + 7-(—1)| < 
|2 ■ 2| + |3 • 3| + |7 • (—1)1 = |2| ■ |2| + |3| ■ |3| + |7| ■ |(— 1)|. The equal sign is retained to take care 
of the rare possibility where the terms are all positive. 

If the input satisfies the condition in Eq. (4.42), then if we replace \x(nT — kT ) by its largest 
possible value as specified in Eq. (4.40), we obtain 

OO 

I y(nT)\ < Y, 1*^)1 P 

k=—oo 

OO 

<p Y i^ r )i ( 4 . 43 ) 

k ——oo 

Now if the impulse response is absolutely summable, that is, 

OO 

Y \ h ( kT )\ < R < oo (4.44) 

k =—oo 


then Eqs. (4.43) and (4.44) give 


\y{nT)\ < Q < oo for all n 

where Q = PR. Therefore, Eq. (4.44) constitutes a sufficient condition for stability. 

A system can be classified as stable only if its response is bounded for all possible bounded 
excitations. Consider the bounded excitation 


x(nT — kT) = 



if h(kT) > 0 
if h(kT) < 0 


where P is a positive constant. From Eq. (4.36b) 


\y(nT)\ = 


OO 

Y h{kT)x{nT - kT) 

k=—o o 


oo oo 

= y p \ h ( kT )\ = p Y \ h{kT) \ 

k =—oo k=—o o 


(4.45) 


since the product h(kT)x(nT — kT) is always positive in this case by virtue of the definition of 
x(nT — kT) in Eq. (4.45). Therefore, the condition in Eq. (4.41) will be satisfied if and only if the 
impulse response is absolutely summable and, therefore, Eq. (4.44) constitutes both a necessary and 
a sufficient condition for stability. Under these circumstances, the system is said to be bounded-input, 
bounded-output (or BIBO) stable. 

Note that although stability is a crucial requirement for most systems, it should be mentioned 
here that there are certain inherently unstable systems which can be useful contrary to popular belief. 
Consider, for example, a continuous-time integrator which is a system that would integrate an input 
waveform. The response of such a system to a unit-step input would increase with time and would 




DISCRETE-TIME SYSTEMS 173 


become unbounded as t —>■ oo since the area under the unit-step over an infinite period is infinite. 
Integrators would be classified as unstable in the above definition, yet they are useful in a number of 
DSP applications. 3 It should be mentioned, however, that such systems are problematic in practice be¬ 
cause the level of their internal signals can easily become large enough to cause them to operate outside 
their linear range. Discrete-time systems also exist that are inherently unstable but which can be use¬ 
ful, for example, discrete-time integrators. These are systems that can perform numerical integration. 

In nonrecursive systems, the impulse response is of finite duration and hence Eq. (4.44) is 
always satisfied. Consequently, these systems are always stable. This is a great advantage in certain 
applications, for example, in adaptive filters which are filters that change their characteristics on line. 
Recursive adaptive filters, would need certain recovery mechanisms to prevent them from becoming 
unstable. 

The stability of a system can be checked by establishing whether the impulse response satisfies 
Eq. (4.44). This boils down to checking whether the series is absolutely convergent, and a number of 
tests are available at our disposal for this purpose such as the ratio test (see Theorem A.3 in Sec. A.5). 


Example 4.12 


(a) Check the system of Fig. 4.5a for stability, (b) A discrete-time system has 
an impulse response 


h(nT ) = u(nT)e 0A " T sin — 

6 


Check the stability of the system. 


■ Solution 


(a) The impulse response of the system was obtained in Example 4.8(a) and is given by 

h(nT) — u(nT)p n 


(See Eq. (4.17)). Hence 

OO 

5Z \h{kT)\ = \ + \p\ + ... + \p k \ + ... 

k ——oo 

This is a geometric series and has a sum 


OO 


V \h(kT)\ = lim 

^' n—> oc 


l - |/?| (n+1) 
i - \p\ 


(4.46) 


3 They used to build analog computers with them during the 1950s and 1960s. 
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(see Eq. (A.46b)). If p > 1, 


oo 


V \h(kT)\ = lim 

z — n —>-oc 


l - \ P \ {n+l) 

i-IpI 



OO 


and if p = 1, 


oo 


Y \WkT)\ = l + l + l + --- = oo 

k =—oo 

On the other hand, if p < 1, 


“ l_\ p \(n+l) 

> |/i(ytr)| = lim -—- 

^ oo 1 - \p\ 


1 


— K < oo 


k=—o o 


i-IpI 

where is a positive constant. Therefore, the system in is stable if and only if 

Ipl < i ■ 


This result explains why the unit-step and sinusoidal responses of the system obtained 
in Examples 4.8(h) and 4.9(h) are bounded if \p\ < 1 and unbounded if \p\ > 1. 

(h) We can write 


]T \h(nT)\ = J2 


k =0 


k =0 


u(kT)e 


0 AkT 


sin 


kix 

~6 


oo 

= E 

*=3,9,15,... 


u(kT)e 01kT 



E 


*^3,9,15,... 


u(kT)e 0AkT 



OO 

= E 

*=3,9,15,... 


e 0AkT 


E 


*^43,9,15,... 


e 0AkT 




oo 


that is, the impulse response is not absolutely summable and, therefore, the system is 
unstable. ■ 


4.8 STATE-SPACE REPRESENTATION 

Systems in general can be represented in terms of equations that involve vectors and matrices. 
Characterizations of this type are usually based on so-called state-space methods and, as will be 
demonstrated in due course, they have certain inherent advantages. Below we develop a state-space 
representation for discrete-time systems. 
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4.8.1 Computability 

The state-space representation to be described is based on Mason’s gain formula (see Sec. 4.4.3) but 
before we proceed with the representation itself, a prerequisite property of signal flow graphs known 
as computability needs to be explained. 

Earlier on, we have shown that given a discrete-time network, a corresponding signal flow 
graph can be obtained. This process can obviously be reversed and given a signal flow graph, a 
discrete-time network can be derived from it. Consider the signal flow graph of Fig. 4.17a and its 
equivalent network shown in Fig. 4.17 b. We observe that the signal flow graph has a loop that does 
not include the shift operator £~ 1 , namely, loop ABCDA. In the network, this loop corresponds to 
the delay-free loop shown enclosed in dashed lines. If a signal x(tiT ) is applied at the input of the 
network, the sum 


w(nT) — x(nT) — b\v{nT) — boy(nT ) 

will appear at the output of the left-hand adder in r A s, where r A is the propagation delay of the 
adder; the product a\w(nT) will then be formed in r m s, where r ;W is the propagation delay of the 



y(nT) 


v(nT ) 


(a) 


Delay-free loop 




(b) 


Figure 4.17 (a) Noncomputable signal flow graph, (b) equivalent network. 
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multiplier. Signals a\w(nT) and a^vUiT) will then be added in t a s to produce a new output 

y'(tiT) = ci\w(nT) + a^vijiT ) 

which will be fed back to the left-hand adder; this will produce the signal 

w'(nT) = x(nT) — b\v(nT) — boy'inT) 

= x(nT) — b\v(nT ) — ba[a\w(nT) + ci 2 v(nT)] 

= x(nT ) — [b\ + bod 2 \v(nT ) — a\bow(nT) 


at the output of the left-hand adder in r 4 s. This chain of events will continue indefinitely and 
the end result would be a runaway situation with the output of the network assuming some unpre¬ 
dictable value. Even though the signal flow graph may represent a valid set of algebraic equations, 
the presence of a delay-free loop renders the flow graph nonimplementable basically because a 
variable depends on itself, namely, w(nT), in the above example. Obviously, flow graphs such as 
the above cannot be implemented in terms of practical networks and are, therefore, of no practical 
interest. They are said to be noncomputable. 

If a unit delay were inserted in the feedback branch in Fig. 4.17b, then signals w(uT) and v(nT ) 
would propagate as far as the input of that unit delay and in the absence of a clock pulse, action 
would stop, the signals would reach steady state, and the runaway situation would not take place. 

The above problem cannot occur if each and every loop in a signal flow graph contains at least 
one shift operator £ _1 in which case the network would have no delay-free loops. Such a signal flow 
graph is said to be computable for obvious reasons. 


4.8.2 Characterization 

Now consider an arbitrary discrete-time network containing N unit delays and assume that its sig¬ 
nal flow graph is computable, i.e., it has no delay-free loops. The network can be drawn as shown 
in Fig. 4.18 a where Subnetwork A consists exclusively of interconnected adders and multipliers. 
Subnetwork A cannot contain any loops since each loop of the network is completed by a unit delay 
which is not part of Subnetwork A, i.e., all loops would be broken if the unit delays in Fig. 4.18 a 
were to be removed as depicted in Fig. 4.186. 

Now let qi ( nT ), for i — 1.2,.... /V, he variables at the outputs of unit delays. These are stored 
quantities and can thus be referred to as state variables. The signals at the inputs of the unit delays 
can obviously be represented by corresponding variables q,(nT + T). 

If all the state variables are assumed to be zero and the input x(nT) is assumed to be nonzero, 
then from Mason’s gain formula given in Eq. (4.15), the response at the input of the ith unit delay 
can be obtained as 


qi (nT + T) = 
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x(nT ) 



y(nT) 


(a) 


x(nT) 



q^nT+T) q^nT) 

• • • 

q n ( nT+T ) 


Subnetwork A 







y(nT) 


qfnT+T) qf.nT) qfnT+T ) q t nT ) 


(b) 

Figure 4.18 Arbitrary discrete-time network. 


where T k is the transmittance of the kth direct path between input and node i, A is the determinant 
of the flow graph, and A/ ; is the determinant of the subgraph that does not touch the kth direct 
path between input and node i (see Sec. 4.4.3). Since there are no complete loops in the graph of 
Subnetwork A, we have 


A = A* = 1 

Furthermore, since there are no unit delays in Subnetwork A, the transmittances T k are independent 
of the shift operator £~ and we conclude that 

q,(nT + T) = biX(nT) (4.47) 

for i = 1,2 ,..., N where b\, bi,..., b N are constants independent of nT for a time-invariant 
discrete-time system. 

Similarly, if input x(nT) and all the state variables except the jth state variable are assumed 
to be zero, we have 


qi(nT + T) = aijqj(nT) 


( 4 . 48 ) 
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for i — 1,2 ,..., N where a ], a 2] ,, a Nj are again constants independent of nT for a time- 
invariant discrete-time system. 

Now if the system is linear, then from the principle of superposition the response at the 
input of the ;th unit delay is the sum of all the contributions originating from all the state vari¬ 
ables plus the contribution from the input of the system. Hence, from Eqs. (4.47) and (4.48), we 
obtain 


N 

q\(nT + T) = ^ aijqj(nT) + bix(nT ) (4.49) 

7=1 

for i = l, 2, ... , N. Similarly, the response of the system, y(nT), is made of contributions from 
all the state variables plus the input of the system, and for the same reasons as before, we have 


N 

y(nT) = c j<lj(. n T) + dox(nT) (4.50) 

7=1 

Therefore, from Eqs. (4.49) and (4.50), the discrete-time system can be characterized by the system 
of equations 

q(nT + T) = Aq(nT) + b x(nT) (4.51a) 

y(nT) = c T q(nT) + dx(nT) (4.51b) 

where 



an an ■ ■ 

■ aiN 


h\ 

A = 

«21 «22 • ■ 

■ a 2 N 

b = 

b 2 


a aii am • • 

■ a^N_ 


pN _ 

c 

T = [ci c 2 • 

■ ■ c N ] 

II 


q (nT) = [qi(nT) q 2 {nT) ■ ■ ■ q N (nT)] T (4.52) 


is a column vector whose elements are the state variables of the discrete-time network. This is referred 
to as a state-space characterization. 
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Example 4.13 


Obtain a state-space representation for the parallel system shown in Fig. 4.19. 


■ Solution 

State variables can be assigned to the system as shown in Fig. 4.19. By inspection, we 
obtain 

q\{nT + T)= \q\(,nT) + x(nT) 
qi(nT + T)= \q 2 (nT) + x(nT) 
qiinT + T)= \qi{nT) + x(nT) 

and 

y(n) = qi(nT) + q 2 (nT ) + 2 q 3 (nT) 
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Therefore, 

q {nT + T) = Aq {nT) + b x{nT) 
y(n) = c r q (nT) + dx{nT ) 

where q (nT) is the state-variable vector and 



loo‘ 


T 


T 

A = 

0 i 0 

b = 

1 

c = 

1 


0 0 I 


1 


2 


In a state-space representation, state-variables can be assigned to nodes arbitrarily, e.g., in 
Example 4.13, q\{nT ) could be assigned to the output of any one of the three unit delays, q 2 (nJ) to 
the output of any one of the two remaining unit delays, and q 2 {nT) to the output of the remaining 
unit delay. In each possible assignment, a different representation would be obtained and, in effect, 
the state-space approach does not yield a unique representation. 

A state-space characterization can also be obtained from a signal flow graph as illustrated by 
the following example. 


Example 4.14 


Obtain a state-space characterization for the system of Fig. 4.6. 


■ Solution 

State variables can be assigned to the flow graph of the system as depicted in Fig. 4.20, 
where 

qi(nT + T) = q 2 {nT ) 
q 2 (nT + T) = q 2 {nT) 

q 2 (nT + T) = — b 2 q\(nT ) — b 2 q 2 (nT) — biq 2 (nT) + x(nT) 

The output of the system can be expressed as 

y{nT) — a 2 q\(nT ) + a 2 q 2 (nT) + a\q 2 (nT ) + a 0 q 2 (nT + T) 
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x(jiT ) 



>y(nT) 


q^nT) 

Figure 4.20 Assignment of state variables for the discrete-time system of Fig. 4.6. 


and on eliminating q 2 (nT + T ), we obtain 
y(nT) = (a 3 - aobi)qi(nT) + ( a 2 - aob 2 )q 2 (nT) + (ai - aob\)q 2 (nT) + a 0 x(nT ) 
Hence, the system can be represented by 

q (nT + T) = Aq (nT) + bx(nT) 

■ 

y(nT) = c r q {nT) + dx(nT) 

where 



o 

o 


'O' 

A = 

0 0 1 

b = 

0 


— b 2 —b 2 —b\ 


1 


and 


c T = [(a 3 - a 0 b 3 ) ( a 2 - a 0 b 2 ) - a 0 i>i)] d = a 0 


q (nT) = [qi{nT ) q 2 (nT) q 2 (nT)Y 


(4.53) 


Note that state variables must always be assigned at the outputs of unit delays but if a signal 
flow-graph representation is used, it is sometimes possible to inadvertently assign one or more 
state variables to nodes that are not outputs of unit delays. Consider, for example, the discrete-time 
network of Fig. 4.21 a which can be represented by the signal flow graph of Fig. 4.21 b. Assigning 
state-variables to nodes 2 and 3 will lead to erroneous results simply because these nodes represent 
the outputs of the adders, not of the unit delays.The problem can be avoided by working directly 
with the network or by inserting new nodes at the outputs of the unit delays as depicted in Fig. 4.21c. 
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5 



a 0 



(b) 



y(nT) 


(c) 


Figure 4.21 Assignment of state variables. 


Example 4.15 


(4.51b) with 


A system can be represented by the state-space equations in Eqs. (4.51a) and 


" 1 

1 

r 


2" 

2 

1 

3 

0 

4 

0 

b = 

0 

0 

1 

0 _ 


0 


Deduce the difference equation of the system. 
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■ Solution 


From Eqs. (4.51a) and (4.51b), the state-space equations can be written out as 


qi(nT + T) = -\q\(nT) - \q 2 (nT) - \q 3 {nT) + 2 x(nT) (4.54a) 

q 2 (nT + T) = qi (nT) (4.54b) 

q 3 (nT + T) = q 2 (nT) (4.54c) 

and 

y(nT) = -\qi(nT)+ \q 2 (nT)+ ±q 3 (nT) + 2x(nT) (4.55) 

From Eqs. (4.54b) and (4.54c), we can write 

£q 2 (nT) = q\(nT ) or qi{nT) = £~ l q\{nT) (4.56a) 

£q 3 (nT) = q 2 (nT) or q 3 (nT) = £~ x q 2 (nT) 

= £~ 2 qi(nT) (4.56b) 

Now if we eliminate q 2 (nT) and q 3 (nT) in Eq. (4.54a), we get 


£qi(nT) =—^qi(nT) — ^£ l q\(nT)—^£ 2 q\(nT) + 2x(nT) 

and hence 


[S+\ + \£~ l + \£~ 2 ] qiinT) = 2 x(nT) 


q\(nT) = 


£ + \ + \£-' + \£~ 2 


x(nT ) 


(4.57) 


Similarly, if we eliminate q 2 (nT) and q 3 (nT) in Eq. (4.55), we get 


y(nT) = -i 9 j (nT) + 2 £~ l q x (nT ) + ±£~ z qi( nT) + 2 x{nT) 

= [-5 + l £ ~ l + J2 S ~ 2 ] ? i ( nT ) + 2x ^ nT ) 

If we now eliminate q\(nT) in Eq. (4.58) using Eq. (4.57), we have 

2 \-i + + i \Z~ 2 ] 

y(nT) = } . 4 , . 6 , „ , . 12 t „ J x(nT) + 2x(nT) 


£ + \ + 2 £- 1 + \£~ 2 


[ 2 - 


\£- l + £~ 2 + |f- 3 ] 


\ + \£~'+ \£~ 2 + \£~ 2 


x(nT) 


(4.58) 
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Alternatively, we can write 

[1 + if 1 + if 2 + if 3 ] y(nT ) = [2+ if 1 +f 2 + |f“ 3 ] x(«T) 

or 

y(«T) = 2x(nT) + \x(nT -T) + x{nT - 2 T) + \x{nT - 3 T) 

- j yinT -T)- \y(nT - 2T) - \y(nT - 3 T) » 


4.8.3 Time-Domain Analysis 

The preceding state-space characterization leads directly to a relatively simple time-domain analysis. 
For n = 0, 1, ..., Eq. (4.51a) gives 

q(T) = Aq(0) + b.v(0) 

q(2 T) = Aq(7) + bx(T) 

q(3 T) = Aq(2T) + bx(2f) 


Hence 

q(2 T) = A 2 q(0) + Abx(0) + b x(T) 

q(3f) = A 3 q(0) + A 2 bx(0) + Abx(T) + bx(2T) 

and in general 

n -1 

q (nT) = A"q(0) + ^ n ~ l ~ k) bx(kT) 

k =0 

where A 0 is the N x N unity matrix. Therefore, from Eq. (4.51b), we obtain 

n— 1 

y(nT) = c r A''q(0) + c r ^ A^- l ~ k) bx(kT) + dx(nT) 

k =0 


If x{nT) = 0 for all n < 0, then for n = — 1 Eq. (4.51a) yields 

q(0) = bix(-T) = 0 


Thus for an initially relaxed system 

n -1 

y(nT) = c r J2 A in - l - k) bx(kT ) + dx(nT) 
k=0 





DISCRETE-TIME SYSTEMS 185 


The impulse response h(nT) of the system is 

n— 1 

h(nT) = c T J2 A( "~ l ~ k)bS ( kT ) + dS(nT) 

k=0 

For n = 0 


/i(0) = dS(nT) — do 


and for n > 0 

h(nT) = c r A (n_1) b5(0) + c r A ( ' ! - 2) b<5(T) + • • ■ + dS(nT) 


Therefore, 


h(nT ) = 


do 

c / A (n - 1) b 


for n = 0 
for n > 0 


Similarly, the unit-step response of the system is 

n— 1 

y(nT) = c T A (B - 1_i) b u(kT) + du(nT) 
k =0 


Hence, for n > 0 


y{nT) = c T J2 A (n_1_i) b + d 
k =0 


(4.59) 


(4.60) 


Example 4.16 


An initially relaxed discrete-time system can be represented by the matrices 


0 1 


0 

1 1 

b = 

1 

.4 2 . 



Find h(\lT). 



d = 


3 

2 


■ Solution 


From Eq. (4.59), we immediately get 


h{\lT) = c r A 16 b 


By forming the matrices A 2 , A 4 , A 8 , and then A 16 through matrix multiplication, we get 


hnm=[l f] 


610 987 



65,536 32,768 


0 

987 1597 


l 

131,072 65,536 




1076 

262,144 
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4.8.4 Applications of State-Space Method 

The state-space method offers the advantage that systems can be analyzed through the manipulation 
of matrices which can be carried out very efficiently using array or vector processors. Another 
important advantage of this method is that it can be used to characterize and analyze time-dependent 
systems, that is, systems in which one or more of the elements of A, b, and c T and possibly constant 
d depend on nT. This advantage follows from the fact that only linearity is a prerequisite property 
for the derivation of the state-state representation. 

Time-varying systems like adaptive filters are now used quite extensively in a variety of 
communications applications. The state-space method can also be used to realize digital filters 
that have certain important advantages, e.g., increased signal-to-noise ratio (see Sec. 14.7). 

A negative aspect associated with state-space time-domain analysis is the fact that the solutions 
are not in closed form in general. 
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PROBLEMS 

4.1. By using appropriate tests, check the systems characterized by the following equations for linearity, time 
invariance, and causality: 

(a) y(nT) = 1Zx(nT) = 1.25 + 2.5x(nT) + 5.0(nT + 2T)x(nT — T) 



for x(nT) < 6 
for x(nT) > 6 


(c) y(nT) = Hx(nT) = (nT + 3 T)x(nT - 3 T) 

4.2. Repeat Prob. 4.1 for the systems characterized by the following equations: 

(a) y(nT) — IZx(nT) = 5nT x 2 (nT) 

(b) y(nT) = IZx(nT) = 3 x(nT + 3 T) 

(c) y(nT) — 1Zx(nT) = x(nT)sauonT 

4.3. Repeat Prob. 4.1 for the systems characterized by the following equations: 

(a) y(nT) — !Zx(nT) = nT + K\Ax(nT) where A x(nT) = x(nT + T) — x(nT) 

(b) y(nT) — !Zx(nT) = 1 + K 2 Vx(nT) where Wx(nT) = x(nT) — x(nT — T) 

(c) y(nT) = 7 Zx(nT) = x(nT + T)e~ nT 

4.4. Repeat Prob. 1.1 for the systems characterized by the following equations: 

(a) y(nT) = !Zx(nT) = x 2 (nT + T)e~" T sin conT 

(b) y(nT) = Tlx (nT) = i e -°' 01 " r x (nT - iT ) 

(c) y(nT + T) = Rx(nT) - Ax(nT) - Vx(nT) 
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4.5. (a) Obtain the difference equation of the discrete-time network shown in Fig. P4.5a. 
( b) Repeat part(a) for the network of Fig. P4.5£>. 



Figure P4.5n 



4.6. (a) Obtain the difference equation of the network shown in Fig. P4.6a. 
( b ) Repeat part(a) for the network of Fig. P4.6£>. 



Figure P4.6a 
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4.7. Two second-order system sections of the type shown in Fig. P4.6 a are connected in cascade as in Fig. P4.7. 
The parameters of the two sections are an, a 2 i, — bn, —&21 anda 12 , a 22 , —bn, —^ 22 . respectively. Deduce 
the characterization of the combined system. 



Figure P4.7 


4.8. Two second-order systems of the type shown in Fig. P4.6a are connected in parallel as in Fig. P4.8. 
Obtain the difference equation of the combined system. 



4.9. Fig. P4.9 shows a network with three inputs and three outputs. 

(a) Derive a set of equations characterizing the network. 

( b ) Express the equations obtained in part (a) in the form 

y = Mx 

where y and x are column vectors given by [y\(nT) V 2 (nT) yz(nT)\ 7 and \x\(nT) % 2 {nT) X}(nT)] T , 
respectively, and M is a 3 x 3 matrix. 
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x 2 (nT) 



x 3 (nT) 


y 3 (nT) 


4.10. The network of Fig. P4.10 can be characterized by the equation 


b = Ca 


where b = [£q b 2 by 1 and a = [cq a 2 fl 3 ] r are column vectors and C is a 3 x 3 matrix. Obtain C. 



Figure P4.10 
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4.11. By using appropriate tests, check the systems of Fig. P4.11a to c for linearity, time invariance, and 
causality. 

(a) The system of Fig. P4.11a uses a device N whose response is given by 

1Zx(nT) = \x{nT)\ 

(b) The system of Fig. P4.11 b uses a multiplier M whose parameter is given by 

m = 0.1 x(nT) 

(c) The system of Fig. P4.11 c uses a multiplier M whose parameter is given by 

m = 0.1i;(;i7’) 

where v(n T ) is an independent control signal. 



Figure P4.11a 



Figure P4.ll b 



4.12. An initially relaxed discrete-time system employs a device D, as shown in Fig. P4.12, which is charac¬ 
terized by the equation 


w(nT) = 2{-\y\v(nT)\ 
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Figure P4.12 


(a) Deduce the difference equation. 

(b) By using appropriate tests, check the system for linearity, time invariance, and causality. 

(c) Evaluate the time-domain response for the period 0 to 10T if the input signal is given by 

x(nT) = u{nT) — 2 u{nT — AT) 

where u(nT) is the unit step. 

(d) What is the order of the system? 

4.13. The discrete-time system of Fig. P4.13 uses a device D whose response to an input w(nT) is d 0 +diw(nT), 
where d 0 and di are nonzero constants. By using appropriate tests, check the system for linearity, time 
invariance, and stability. 



4.14. A discrete-time system is characterized by the equation 
y(nT) = TZx(nT) 

= a^xitiT) + ctix(nT — T) + nTx(ttT)x(nT — T) + aoaix(nT — 2 T) 

(a) By using appropriate tests, check the system for linearity, time invariance, and stability. 

(b ) Find the unit-step response at t = 5T if a 0 — 2, a\ = 3, and T = 1 assuming that the system is 
initially relaxed. 
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4.15. The system of Fig. P4.15 is initially relaxed. Find the time-domain response for the period nT = 0 
to 6 T, if 


x{nT) = 


f sin con T 

1 ° 


for n > 0 
otherwise 


where a> = jr/6 T and T — 1. 



Figure P4.15 

4.16. (a) Obtain the signal flow graph of the system shown in Fig. P4.16. 

( b ) Deduce the difference equation by using the node elimination method. 


m 21 



4.17. (a) Obtain the signal flow graph of the system shown in Fig. P4.17. 

(b) Deduce the difference equation by using the node elimination method. 



Figure P4.17 




'3 









































DISCRETE-TIME SYSTEMS 193 


4.18. (a) Obtain the signal flow graph of the system shown in Fig. P4.6a. 

(b) Deduce the difference equation by using the node elimination method. 

4.19. Deduce the difference equation of the system shown in Fig. 4.19 by using the node elimination method. 

4.20. Derive a closed-form expression for the response of the system in Fig. 4.5a to an excitation 


x(nT) = 


for 0 < n < 3 
otherwise 


The system is initially relaxed and p = \. 

4.21. (a) Show that 


r(nT) = 


0 

T ELi u(nT - kT) 


for n < 0 
otherwise 


(b) By using this relation obtain the unit-ramp response of the system shown in Fig. 4.5a in closed form. 
The system is initially relaxed. 

(c) Sketch the response for a > 0, a = 0, and a < 0. 

4.22. The excitation in the first-order system of Fig. 4.5a is 

{ 1 for 0 < n < 4 

2 for n > 4 

0 for n < 0 

Find the response in closed form. 

4.23. Repeat Prob. 4.22 for an excitation 


x(nT) = 


for n — 0 

forn < 0, n — 1,2, 3, 4 
for n > 4 


4.24. Fig. P4.24 shows a second-order recursive system. Using MATLAB or similar software, compute and 
plot the unit-step response for 0 < n < 15 if 

(a) a = 1 /S = - \ 

(b) a = 1 0 = 

W « = | 0 = -! 

Compare the three responses and determine the frequency of the transient oscillation in terms of T where 
possible. 



Figure P4.24 
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4.25. Fig. P4.25 shows a system comprising a cascade of two first-order sections. The input signal is 

sin am T for n > 0 


x(nT) = 


0 


otherwise 



Figure P4.25 


and T = 1 ms. 

(a) Assuming that the two sections are linear, give an expression for the overall steady-state sinusoidal 
response. 

(b ) Compute the gain and phase shift of the system for a frequency a> = 20tt rad/s. Repeat for a> — 
2007r rad/s. 

4.26. Fig. P4.26 shows a linear first-order system. 

(a) Assuming a sinusoidal excitation, derive an expression for the steady-state gain of the system. 

( b ) Using MATLAB, compute and plot the gain in decibels (dB), that is, 201ogM(a>), versus log a> for 
cd = 0 to 6 krad/s if T = 1 ms. 

(c) Determine the lowest frequency at which the gain is reduced by 3 dB relative to the gain at zero 
frequency. 



4.27. Two first-order systems of the type shown in Fig. 4.5a are connected in parallel as in Fig. P4.8. The 
multiplier constants for the two systems are m i = e 0 6 and m 2 = e 0 7 . Find the unit-step response of the 
combined network in closed form. 

4.28. The unit-step response of a system is 


y{nT) = 



for n > 0 
for n < 0 


(a) Using the convolution summation, find the unit-ramp response. 

(b) Check the system for stability. 
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4.29. A nonrecursive system has an impulse response 

{ n T for 0 < n < 4 

(8 - n)T for 5 < n < 8 

0 otherwise 

The sampling frequency is 2n rad/s. 

(a) Deduce the network of the system. 

( b ) By using the convolution summation, determine the response y(nT) at nT = 4 T if the input signal 
is given by 

x(nT) = u(nT — T)e~ nT 

(c) Illustrate the solution in part (b) by a graphical construction. 

4.30. An initially relaxed nonrecursive causal system was tested with the input signal 

x{nT) — u(nT) + u(nT — 2 T) 

and its response was found to be as shown in the following table: 


n 

0 

1 

2 

3 

4 

5 


100 


y(nT) 

3 

5 

9 

11 

12 

12 


12 



(a) Find the impulse response for the period 0 to 5T. 

( b ) Find the response for the period 0 to 5 T if the input is changed to 

xinT) = u(nT ) — u(nT — 2 T) 

4.31. The response of an initially relaxed fifth-order causal nonrecursive system to the excitation 

x(nT) = u(nT)n 


is given in the following table: 


n 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


y (nT) 

0 

1 

3 

7 

14 

25 

41 

57 

73 

89 

105 



(a) Find the impulse response. 

(b) Obtain the difference equation. 

4.32. A discrete-time system has an impulse response 

h{nT) = u(nT)nT 

(a) Using the convolution summation, find the response y(nT) for an excitation 

x(nT) = u(nT) sin 2nT 

at nT = AT. The sampling frequency is a> s = 16 rad/s. 

( b ) Illustrate graphically the steps involved in the solution of part (a). 
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4.33. An initially relaxed nonrecursive system was tested with the input signal 

x(nT) = 2u{nT) 


and found to have the response given in the following table: 


n 

0 

1 

2 

3 

4 

5 


100 


y(nT) 

2 

6 

12 

20 

30 

30 


30 



(a) Deduce the difference equation. 

( b ) Construct a possible network for the system. 

4.34. The unit-step response of an initially relaxed nonrecursive causal system is given in the following table: 


n 

0 

1 

2 

3 

4 

5 


y(nT ) 

0 

1 

9 

36 

100 

225 



(a) Find the impulse response for 0 < nT <5 T using the convolution summation. 

(b) Assuming that the general pattern of the impulse response continues in subsequent values of nT, 
write a closed-form expression for the impulse response. 

(c) Is the system stable or unstable? Justify your answer. 

4.35. (a) A discrete-time system has an impulse response 


1 

h(nT) = u(nT — T)— 
n 

By using an appropriate test, check the system for stability. 
(b) Repeat part (a) for the system characterized by 


h(nT) = u{nT - T)- 


1 


4.36. Check the systems represented by the following impulse responses for stability: 
u(nT)n 


(a) h(nT) - 

( b) h(nT) = 


2 " 

u(nT)n 
n + 1 


(c) h{nT) = u(nT - T) 


(n + 1) 


4.37. ( a ) Check the system of Fig. P4.37a for stability. 
( b ) Repeat part (a) for the system of Fig. P4.37ft. 
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y(„T) 


Figure P4.37 b 

4.38. (a) Derive a state-space representation for the system of Fig. P4.38. 
( b ) Calculate the response y(nT) at nT = 3T for an excitation 

x(nT) = 28(nT) + u(nT) 

if mi = 1 and m 2 = \. 


x(nT ) 



Figure P4.38 


4.39. Derive a state-space representation for the system of Fig. 

4.40. Derive a state-space representation for the system of Fig. 

4.41. Derive a state-space representation for the system of Fig. 

4.42. Derive a state-space representation for the system of Fig. 

4.43. Derive a state-space representation for the system of Fig. 


P4.5fl. 

P4.6fl. 

P4.17. 

4.21a. 

P4.43. 


x(nT) 



y(nT) 


Figure P4.43 
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4.44. Derive a state-space representation for the system of Fig. P4.44. 



4.45. The system in Fig. 4.5c is initially relaxed. 

(a) Derive a state-space representation. 

(b) Give an expression for the response of the system at nT = 5T if 

x{nT ) = M (n T) si n eon T 

4.46. Derive a state-space representation for the system of Fig. P4.46. 



Figure P4.46 


4.47. An initially relaxed discrete-time system is characterized by the state-space equations with 


A = 


0 1 
-4 -1 



= [¥ 2 ] 


d = 2 


(a) Calculate the impulse response for the period nT = 0to5 T and for nT = ITT using the state-space 
method. 

(b) Calculate the unit-step response for nT = 5T. 

4.48. (a) Deduce the difference equation of the system in Prob. 4.47. 

(b) Calculate the impulse response for the period nT = 0 to 5 T by using the difference equation. 

(c) Calculate the unit-step response for nT = 5T by using the difference equation. 

4.49. A discrete-time system is characterized by the state-space equations with 


- o r 


'o' 

i i 

b = 

1 

- 4 2- 




c r =H§] d = l 
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(a) Assuming that y(nT) = 0 for n < 0, find y(nT) for the period nT = 0 to 5T if x(nT) = S(nT). 

(b) Repeat part (a) if x(nT ) = u(nT) 

(c) Derive a network for the system. 

4.50. A signal 

x(nT) = 3u(nT) cos amT 

is applied at the input of the system in Prob. 4.47. Find the response at instant 5T if a> = 1/ 10F by using 
the convolution summation. 

4.51. Find the response of the system in Prob. 4.47 at nT = 5T if the excitation is 

x{nT) = u(nT — T)e~ nT 

4.52. Find the response of the system in Prob. 4.49 at nT = 5T if the excitation is 

x{nT) — u(nT) + u(nT — 2 T) 
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CHAPTER 

5 


THE APPLICATION 
OF THE Z 
TRANSFORM 


5.1 INTRODUCTION 

Through the use of the z transform, a discrete-time system can be characterized in terms of a so-called 
discrete-time transfer function, which is a complete representation of the system in the z domain. 
The transfer function can be used to find the response of a given system to an arbitrary time-domain 
excitation, to find its frequency response, and to ascertain whether the system is stable or unstable. 
Also, as will be shown in later chapters, the transfer function serves as the stepping stone between 
desired specifications and system design. 

In this chapter, the discrete-time transfer function is defined and its properties are examined. It 
is then used as a tool for the stability, time-domain, and frequency-domain analysis of discrete-time 
systems. In Sec. 5.2, it is shown that the transfer function is a ratio of polynomials in complex 
variable z and, as a result, a discrete-time system can be represented by a set of zeros and poles. 
In Sec. 5.3, it is shown that the stability of a system is closely linked to the location of its poles. 
Several stability criteria are then presented, which are simple algorithms that enable one to determine 
with minimal computational effort whether a system is stable or unstable. Sections 5.4 and 5.5 deal 
with general time-domain and frequency-domain methods, respectively, that can be used to analyze 
systems of arbitrary order and complexity. The chapter concludes by introducing two types of system 
imperfection, known as amplitude distortion and delay (or phase ) distortion, which can compromise 
the quality of the signal being processed. 
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5.2 THE DISCRETE-TIME TRANSFER FUNCTION 

The transfer function of a discrete-time system is defined as the ratio of the z transform of the 
response to the z transform of the excitation. 

Consider a linear, time-invariant, discrete-time system, and let x{nT), y(nT), and h(nT) be 
the excitation, response, and impulse response, respectively. From the convolution summation in 
Eq. (4.36a), we have 

OO 

y(nT) = Y x(kT)h(nT - kT) 

k=—o O 

and, therefore, from the real-convolution theorem (Theorem 3.7), 

ZyinT) = Zh{nT)Zx{nT) 


or T(z) = H(z)X(z) 

In effect, the transfer function of a discrete-time system is the z transform of the impulse response. 

Continuous-time systems can also be characterized in terms of transfer functions. In later 
chapters we shall be dealing with analog filters, which are continuous-time systems, and with digital 
filters, which are discrete-time systems, at the same time. To avoid possible confusion, we refer to the 
transfer functions of analog systems as continuous-time and those of digital systems as discrete-time. 

The exact form of II (z) can be derived (i) from the difference equation characterizing the 
system, (ii) from a network representation of the system, or (iii) from a state-space characterization, 
if one is available. 

5.2.1 Derivation of H(z) from Difference Equation 

A noncausal, linear, time-invariant, recursive discrete-time system can be represented by the differ¬ 
ence equation 


N N 

y(nT) — Chx(nT — iT) — Y^ bjy(nT — iT) 

i=—M i=l 

where M and N are positive integers. On applying the z transform to both sides of the difference 
equation, we get 


N N 

Zy{nT) = Z Y^ cijXfiT — iT) — Z bjyinT — iT) 

i=—M i = l 

If we use the linearity and time-shifting theorems of the z transform, we obtain 

N N 

Y(z) = Zy(nT)= Y Zx(nT) - Y^ 2y(nT) 

i=—M i=l 

N N 

= Y a iz~‘x(z)-Y b ‘ z ~‘ Y ^ 

i=—M i =1 
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Now if we solve for Y(z)/ X(z) and then multiply the numerator and denominator polynomials by 
Z N , we get 


Y(z) = ‘ = EpL -[ 

X(Z) 1 + Ef=i biZT* z N + Elib i z N ~ i 

d(-M)Z M+N + CI(-m+1)Z M+N ~ 1 + • ■ ■ + djq 
Z N + bu N ~ l H-b b N 


(5.1) 


For example, if M — N = 2 we have 


H(z) = 


N(z) 

D(z) 


a ( - 2 )Z 4 + ci(-i)Z 3 + aoz 2 + a lZ + ai 
Z 2 + biz + b 2 


For a causal, linear, time-invariant system, we have M = 0 and hence the transfer function 
assumes the form 


_ J2to a iZ N ‘ _ a oZ N + a\Z N 1 + • • • + fl;y 

z N + Y,tib i z N ~ i z N + b lZ N ~ l + --- + b N 

If we compare Eqs. (5.1) and (5.2), we note that in a noncausal recursive system, the degree of the 
numerator polynomial is greater than that of the denominator polynomial. 

In a nonrecursive system, coefficients b, are all zero and hence the above analysis gives 


H(z) — a ( -M)Z M + a ( -M+i)Z M 1 + • • • + fljvz N 

_ a(-M)Z M+N + a(-M+i)Z M+N 1 + • • • + on 

- ^ 

The order of a discrete-time transfer function, which is also the order of the system, is the order 
of N(z) or IXz), whichever is larger, i.e., M + N, if the system is noncausal or N if it is causal. 

By factorizing the numerator and denominator polynomials, the transfer function of an arbitrary 
discrete-time system can be put in the form 


H(z) = 


N(z ) 
D(z) 


HoU^z-zir 

nf=i(2 - Pi) ni 


(5.4) 


where 

Zi, z 2 , ■ ■ ■, Zz are the zeros and p\ , p 2 , ..., Pn are the poles of H( Z ), 
in, and 7i, are the orders of zero z, and pole /;,, respectively, 

M + N — Ef=i m i is the order of the numerator polynomial N(z), 

N — Ef=i n i is the order of the denominator polynomial I)(z), and 
Ho is a multiplier constant. 

Thus a discrete-time system can be represented by a zero-pole plot such as the one in Fig. 5.1. From 
Eq. (5.3), we note that all the poles of a nonrecursive system are located at the origin of the z plane. 
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fimz 


O 


z plane 


X 


X 


o 




X 


X 


o 


Figure 5.1 Typical zero-pole plot for H(z). 

5.2.2 Derivation of H(z ) from System Network 

The z-domain characterizations of the unit delay, the adder, and the multiplier are obtained from 
Table 4.1 as 

K 

Y(z ) = z~ 1 X(z) Y(z) = ^2 Xj(z ) and Y(z) — mX(z) 

/=i 

respectively. By using these relations, // (z.) can be derived directly from a network representation 
as illustrated in the following example. 


Example 5.1 


Find the transfer function of the system shown in Fig. 5.2. 


■ Solution 

From Fig. 5.2, we can write 

W(z) = X(z)+ \z~ l W(z)~ \z~ 2 W{z) 

Y(z) = W(z) + z~ l W{z) 

Hence 

W(z)= - - , . and r(z) = (1 + z-'Wiz) 

1 - iz- 1 + \z~ 2 


Y(z) 

X(z) 



Therefore, 
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5.2.3 Derivation of H(z) from State-Space Characterization 

Alternatively, H(z ) can be deduced from a state-space characterization. As was shown in Sec. 4.8.2, 
an arbitrary discrete-time system can be represented by the equations 

q (nT + T) = Aq (nT) + b x(nT) (5.5a) 

y(nT) = c r q (nT) + dx(nT ) (5.5b) 

(see Eqs. (4.51a) and (4.51b)). By applying the z transform to Eq. (5.5a), we obtain 

Zq(nT + T) = AZq(nT) + bZx(nT) = AQ(z) + bX(z) (5.6) 


and since 


Zq(nT + T) = zZq(nT) = zQ(z) 


(5.7) 


Equations (5.6) and (5.7) give 


zQ (z) = AQ (z) + bX(z) 

or Q(z) = (zl- A)-‘bX(z) (5.8) 

where I is the N x N identity matrix. Now on applying the z transform to Eq. (5.5b), we have 

Y(z) — c t Q (z) + dX(z) 
and on eliminating Q(z) using Eq. (5.8), we get 


Y(z) 

X(z) 


N(z) T i 

H ^= = c l b + d 

D(z) 


(5.9) 
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Example 5.2 


Eq. (5.5) with 


A discrete-time system can be represented by the state-space equations in 



■ i r 


'2 

A = 

2 3 

1 0 

b = 

0 


Deduce the transfer function of the system. 


■ Solution 


The problem can be solved by evaluating the inverse of matrix 


(zl - A) 



i ■ 

3 

Z 


and then using Eq. (5.9). 

The inverse of an n x n matrix 


is given by [1, 2] 


A = 


A’ 1 = 


det A 


an a 12 ■ • • ai n 

021 Cl22 ■■ ■ Cl2n 

O/jl O n 2 ‘ ' ‘ ®nn 


An A12 • • • Ai„ 
A 2 i A 2 2 ■ ■ ■ A 2 „ 

Ani A,, 2 ■ ■ ■ A /ih 


where det A is the determinant of A, 

A l} = (~\) l+ J det M t j 


(5.10) 


(5.11a) 


and Mjj represents matrix A with its zth row and / th column deleted. A and det M,j are 
known as the cofactor and minor determinant of element i/, ; , respectively. For a 2 x 2 
matrix, we have 


l-i 


1 

An Ai 2 

T 

l 

022 —021 

det A 

A 2 i A 22 


det A 

— 012 On 


det A 


022 — «12 
-021 On 


(5.11b) 
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Now from Eqs. (5.10) and (5.11b), we obtain 
(zI-A)" 1 = 


(Z + + 3 


1 Z + 


2.1 


and from Eqs. (5.9) and (5.12), we have 

H(z) = c r (zl — A) _1 b - 
1 


(z + \)z + 5 


r_i ii 

z “5 


'2 

L 4 6J 

z + \. 


0 


z 2 + $z+5 

1 


[-H] 


'\z + 5 + 2 z“ + z + | 
z 2 + \z + i 


2 z 2 + \z + 1 
z 2 + kz + i 


(5.12) 


5.3 STABILITY 

As can be seen in Eq. (5.1), the discrete-time transfer function is a rational function of z with real 
coefficients, and for causal systems the degree of the numerator polynomial is equal to or less than 
that of the denominator polynomial. We shall now show that the poles of the transfer function or, 
alternatively, the eigenvalues of matrix A in a state-space characterization, determine whether the 
system is stable or unstable. 


5.3.1 Constraint on Poles 


Consider a causal system with simple poles characterized by the transfer function 


H(z) = 


N(z) 

D(z) 


/ft S,Viz"" 1 

ntife - Pi) 


(5.13) 


where N > M and assume that the numerator and denominator polynomials N(z) and D(z) have 
no common factors that are not constants, i.e., they are relatively prime. Since such common factors 
can be canceled out at any time, they have no effect on the response of the system and, therefore, 
cannot affect its stability. The impulse response of such a system is given by 

h{nT) = Z~ l H(z) = { H(z)z"~ 1 dz 

Jr 


and from Eq. (3.8), we get 


N 

h(0) = R 0 + J2 Kes z=Pi [z~ l H(z)] 
1 = 1 


(5.14a) 
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where 


Ro = 


\9\es z= o [^r^] if H(z)/z has a pole at the origin 


and 


otherwise 


h(nT) = Y <Res[H(z)z n ~ l ] 

* 7= 77; 


(5.14b) 


for all n > 0. 

Now if an arbitrary function F(z) has a simple pole at z = Pi and a function G(z) is analytic 
at z = Pi , then it can be easily shown that 


9les[F(z)G(z)] = G{ Pi )?fKes F{z) 

Z=Pi Z=Pi 

(see Prob. 5.9). Thus Eqs. (5.14a)-(5.14c) give 

Ro + Eh Pi 1 Vtes z = Pl H(z) for n = 0 


(5.14c) 


h(nT) = 


E,=i Pi 1 ^ es z= P , H{z) 


for n > 0 


where the i th term in the summations is the contribution to the impulse response due to pole p,. If 
we let 

Pi = fie^' 

then the impulse response can be expressed as 

' Ro + Ell rr'e-j* ftes z=Pl H(z ) for n = 0 

(5.15) 

Eh y mes z=Pl H(z) for n > 0 

At this point, let us assume that all the poles are on or inside a circle of radius r max , that is, 

n < r max for i = 1, 2, ... , N (5.16) 

where r nlax is the radius of the most distant pole from the origin. From Eq. (5.15), we can write 


h(nT ) = 


y\h{nT)\ = 


n =0 


Ro + y esH{z) 

• ^ 7= ns 


1 = 1 


l=Pi 


E 

n= 1 


Vr"-i eR n - l) *‘mes H(z) 

‘ ^ z=pi 


i= 1 


and since \e jf> \ = 1 and the magnitude of a sum of complex numbers is always equal to or less than 
the sum of the magnitudes of the complex numbers (see Eq. (A. 18)), we have 


OO N 


y\h(nT)\ < |/? 0 | + ^rr 1 |^H(j:)| + ^^r; i - 1 |^f/(z)| 


n= 0 


n= 1 /=! 


(5.17) 
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From the basics of complex analysis, if pi- is a simple pole of some function F(z), then function 
(z — Pk)F(z) is analytic at z = Pk since the factor (z — pk) will cancel out the same factor in the 
denominator of F(z) and will thereby remove pole pk from F(z). Hence, the residue of F(z) at 
Z = pk is a finite complex number in general. For this reason, Rq as well as all the residues of H(z) 
are finite and so 


| 9\es H(z) | < Rmax for i = 1,2,..., N 

Z=Pi 

where R mdx is the largest residue magnitude. If we replace the residue magnitudes by R mdx and the 
radii of the poles by the largest pole radius r mdx in Eq. (5.17), the inequality will continue to hold 
and thus 


OO 

J2\h(nT)\ < \Rq\ + NR max ^"max 

n =0 


NR„ 


F max 


oo 


E 


r 


n 

max 


n= 1 


The sum at the right-hand side is a geometric series and if 

f max 1 

the series converges and, therefore, we conclude that 

OO 

| h(nT)\ < K < oo 

n =0 

where K is a finite constant. In effect, if all the poles are inside the unit circle of the z plane, then 
the impulse response is absolutely summable. 

Let us now examine the situation where just a single pole of Fl(z), let us say pole pk, is located 
on or outside the unit circle. In such a case, as n — > oo the contributions to the impulse response 
due to all the poles other than pole pk tend to zero since r, < 1 and r"~ l —> 0 for i f k, whereas 
the contribution due to pole pk either remains constant if r<- = 1 or tends to get larger and larger if 
rk > 1 since r'^~ l is increased as n is increased. Hence for a sufficiently large value of n, Eq. (5.15) 
can be approximated as 

h(nT) » rrV 1 "- 1 ^ Vies H(z ) 
z=Pk 

and thus Eq. (5.17) gives 



Since > 1, the above geometric series diverges and as a consequence 

OO 

\h(nT)\ —»■ oo 

n =0 


(5.18) 
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Figure 5.3 Permissible z-plane region for the location of the poles of H(z). 

That is, if at least one pole is on or outside the unit circle, then the impulse response is not absolutely 
summable. 

From the above analysis, we conclude that the impulse response is absolutely summable, if 
and only if all the poles are inside the unit circle. Since the absolute summability of the impulse 
response is a necessary and sufficient condition for system stability, the inequality in Eq. (5.16) with 
fmax < 1, that is, 


| pi | < 1 for i = 1, 2,..., N 

is also a necessary and sufficient condition for stability. The permissible region for the location of 
poles is illustrated in Fig. 5.3. 

The above stability constraint has been deduced on the assumption that all the poles of the 
system are simple. However, the constraint applies equally well to the case where the system has 
one or more higher-order poles (see Prob. 5.10). 

In Sec. 4.6.2, we found out that in nonrecursive systems the impulse response is always of 
finite duration and that assures its absolute summability and, in turn, the stability of these systems. 
This result is confirmed here by noting that the poles of these systems are always located at the origin 
of the z plane, right at the center of the region of stability, as can be seen in Eq. (5.3). 


Example 5.3 


Check the system of Fig. 5.4 for stability. 


■ Solution 


The transfer function of the system is 


H(z) = 


z 2 - z + 1 
z 2 -z + \ 


z 2 - z + 1 
(z - pi)(z - Pi) 
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where 

Pl’P2= \ ±j\ 

since 

\pii\pi\ < i 

the system is stable. ■ 


5.3.2 Constraint on Eigenvalues 

The poles of H(z) are the values of z for which D(z), the denominator polynomial of II (z), becomes 
zero. The inverse of a matrix is given by the adjoint of the matrix divided by its determinant (see 
Eq. (5.1 la)). Hence, D(z) can be obtained from Eqs. (5.9) and (5.1 la) as 


D(z ) = det(zl - A) 


(see Example 5.4 below). Consequently, D(z) is zero if and only if 

det(zl - A) = 0 

Now the determinant of (zl — A) is the characteristic polynomial of matrix A [1, 2] and, conse¬ 
quently, the poles of an ATh-order transfer function H (z) are numerically equal to the N eigenvalues 
A.i, A. 2 ,..., A.;v of matrix A. Therefore, a system characterized by the state-space equations in Eq. (5.5) 
is stable if and only if 


| A., ] < 1 for i = 1, 2, ... , N 
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Example 5.4 


with 


A discrete-time system is characterized by the state-space equations in Eq. (5.5) 


r l 

1 

n 


r 2 i 

2 

1 

3 

0 

4 

0 

b = 

0 

0 

1 

0 


0 


Check the system for stability. 

■ Solution 

One approach to the problem would be to find the denominator of the transfer function 
D(z ) and then find the zeros of D(z), which are the poles of the transfer function. We 
can write 


zl — A = 


and from Eq. (5.1 la), we obtain 


(zI-A)- 1 = 


1 


det(zl — A) 


7 + i I i 

-1 z 0 
0 -1 z 


z -z 
kz + j (z + \)z 


3 4 1 4 

-\z 


-(z + j) 
(z + h)z + 1 


Hence Eq. (5.9) yields 


y(z) , n(z) T A ._ lfc 

= H(z) = —— — c (zl - A) b 


X(z) 


D(z) 


1 


det(zl — A) 


1 


r_i i n 

L 4 6 12 J 


r_i i n 

L 4 6 12 J 


A z 

A ~ 


r Z 2 |z+3 

-z (z + \)z \ 

1 —(z + j) (z + |)z + 3 

2 z 2 



~2 


0 


0 


-2z 

2 


det(zl - A) 

Thus polynomials N(z) and D(z) can be deduced as 


N(z) = [- 


.! i 2-1 

4 6 12 J 


2 z 2 " 
—2z 
2 


2 det(zl — A) 


(5.19a) 


and 


D(z) = det(zl - A) 


(5.19b) 
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respectively. Since N(z ) has nothing to do with stability, all we need to do is to find the 
determinant of matrix zl — A. 

The determinant of a 3 x 3 matrix 


A = 


a 11 a 12 a 13 
021 a 22 O23 
031 O32 O33 


can be readily obtained by writing two copies of the matrix side by side as follows 


1 On 

012 

013 

1 On 

012 

013 1 


\ 

\ 

\ 



021 

022 

023 

021 

022 

023 1 



\ 

\ 

\ 


O31 

O32 

033 

O31 

O32 

033 1 


The sum of element products along the south-east diagonals shown form the positive 
part of the determinant, 


D = 011022033 + 012023031 + 013021032 


On the other hand, the sum of the products along the south-west diagonals shown below 


Oil 

O12 

013 

1 011 

012 

013 




j/ 



021 

022 

023 

021 

022 

023 







031 

O32 

033 

O31 

O32 

033 


form the negative part of the determinant, 

D = 011023032 + 012021033 + 013022031 


The determinant of A is given by 

detA = D + - D~ 

= (011032033 + 012023031 + 013021032) 

—(011023032 + 012021033 + 013022031) ( 5 . 20 ) 

Thus from Eq. ( 5 . 19 b) and the above arrays (or from Eq. ( 5 . 20 )), we obtain 

D(z) = det(zl - A) = [(z + \)z 2 + 5] - (-|z) 

= Z 3 + \z 2 + 5Z + \ 









214 DIGITAL SIGNAL PROCESSING 


Using function roots of MATLAB, the poles of the system can be obtained as 

Po = —0.6168 or \p 0 \ = 0.6168 
pu p 2 = 0.0584 ± y'0.6340 or \ Pl \ = \p 2 \ = 0.6367 

and since \p,\ < 1 for i = 0, 1, and 2, the system is stable. ■ 

If the pole positions are not required, then the stability of the system can be easily 
ascertained by applying the Jury-Marden stability criterion (see Sec. 5.3.7). 


5.3.3 Stability Criteria 

The stability of a system can be checked by finding the roots of polynomial D(z ) or the eigenvalues 
of matrix A in a state-space representation. For a second- or third-order system, this is easily accom¬ 
plished. For higher-order systems, however, the use of a computer program 1 is necessary. In certain 
applications, the designer may simply need to know whether a system is stable or unstable and the 
values of the poles of the transfer function may not be required. In such applications, the stability of 
the system can be checked quickly through the use of one of several available stability tests or criteria 
like the Schur-Cohn and Jury-Marden criteria [3]. Typically, these criteria are simple algorithms that 
involve an insignificant amount of computation relative to that required to find the roots of D(z). 

Some of the more important stability criteria will now be described. Derivations and proofs 
are omitted for the sake of brevity but the interested reader may consult the references at the end of 
the chapter. 

Consider a system characterized by the transfer function 


where 


and 


H(z) = 


N(z ) 
D(z) 


M 

N(z) = ^ a iZ M ~ l 
1=0 

N 

D(z) = ^ b,Z N -' 
i =o 


(5.21) 

(5.22a) 

(5.22b) 


and assume that bo > 0. This assumption simplifies the exposition of the stability criteria quite a bit. 
If bo happens to be negative, a positive b (t can be obtained by simply replacing all the coefficients in 
D(z) by their negatives. This modification amounts to multiplying the numerator and denominator 
of the transfer function by — 1 and since such a manipulation does not change the response of the 
system, it does not affect its stability. Assume also that N(z) and D(z.) have no common factors that 
are not constants. If there are such common factors in these polynomials, they must be identified and 


1 For example, function roots of MATLAB. 






THE APPLICATION OF THE Z TRANSFORM 215 


canceled out before the application of one of the stability criteria. Otherwise, a false result may be 
obtained, for example, if a common factor has a root inside the unit circle. In such a case, the transfer 
function will have a pole inside the unit circle that has nothing to do with the stability of the system. 


5.3.4 Test for Common Factors 


The presence of common factors in /Viz) and D(z) can be checked by applying the following test. 
The coefficients of N(z ) and D(z) are used to construct the N x (N + M ) and M x (N + M ) matrices 


It v = 


and 


R 


■M 


CIq d\ 

0 ao a\ 


0 0 0 


0 0 0 

0 b 0 b\ 
bo b\ bo 


O.M -1 a M 


0 

0 


0 

0 


ao a i 


0 0 0 h 0 

h/v 

bjv 0 0 


respectively. Then the (N + M ) x (N + M) matrix 

R = 


R/v 

Rm 


is formed and its determinant is computed. If 


O-M -1 Om 


h/v-i 

0 

0 


det R / 0 

then N(z) and D(z) do not have a common factor that is not a constant, i.e., the two polynomials are 
relatively prime [4, 5]. Otherwise, if 


det R = 0 

the two polynomials are not relatively prime. 

In most practical situations, for example, in the transfer functions obtained through the design 
processes to be described in later chapters, polynomials N(z) and D(z) are almost always relatively 
prime but the possibility that they might not be should not be totally ignored. 


Example 5.5 


Check the numerator and denominator polynomials of the transfer function 


H(z) = 


N(z) 
D(z ) 


z 2 + 3z + 2 
3z 3 + 5z 2 + 3z + 1 


for common factors. 
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■ Solution 


Matrix R can be formed as 


1 

3 

2 

0 

0 

0 

1 

3 

2 

0 

0 

0 

1 

3 

2 

0 

3 

5 

3 

1 

3 

5 

3 

1 

0 


Through the use of MATLAB, we find that det R = 0. Therefore, N(z) and D(z) have a 
common factor that is not a constant. In actual fact 


H(z) = 


(z + l)(z + 2) 

(z+ l)(3z 2 + 2z + 1) " 


5.3.5 Schur-Cohn Stability Criterion 

The Schur-Cohn stability criterion was established during the early twenties [3], long before the era 
of digital systems, and its main application at that time was as a mathematical tool for the purpose of 
establishing whether or not a general polynomial of z has zeros inside the unit circle of the z plane. 
This criterion has been superseded in recent years by other more efficient criteria and is rarely used 
nowadays. Nevertheless, it is of interest as it is the basis of some of the modern criteria. 

The Schur-Cohn criterion states that a polynomial D(z) of the type given in Eq. (5.22b), whose 
coefficients may be complex, has roots inside the unit circle of the z plane if and only if 


detS 



if k is odd 
if k is even 


for k = 1,2,... , N where Sr- is a 2k x 2k matrix given by 



b N 

0 

0 • 

■■ 0 

bjv-i 

b N 

0 • 

■■ 0 

’N-k+l 

t>N-k+2 bN-k+3 ' 

■ • b N 


with 
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and 


bo bi b 2 ■ ■ ■ b k „i 
0 b 0 bi ■■ ■ b, t_ 2 


0 0 0 b 0 


The polynomial coefficients bo,bi,... , b N can, in general, be complex. Polynomials whose roots 
are inside the unit circle are sometimes referred to as Schur polynomials [5]. 

The Schur-Cohn criterion involves the evaluation of the determinants of N matrices of dimen¬ 
sions ranging from 2 x 2 to 2N x 2N, which would require a large amount of computation. 


5.3.6 Schur-Cohn-Fujiwara Stability Criterion 

A more efficient stability criterion was developed by Fujiwara during the mid-twenties [3]. This is 
actually a modified version of the Schur-Cohn criterion and for this reason it is usually referred to as 
the Schur-Cohn-Fujiwara criterion. In this criterion, the coefficients of D(z), which can be complex, 
are used to construct the N x N matrix 


where 


F = 


/ll • ' ' flN 

,/ivi ■■ ■ Inn 


min (ij) 

fij = ^2, (bi-k bj-k — bN-i+k bpi-j+k) 

k— 1 


(5.23) 


The Schur-Cohn-Fujiwara criterion states that the zeros of D(z ) are located inside the unit circle if 
and only if F is a positive definite matrix. 

An N x N matrix F is said to be positive definite if the quadratic form x r Fx is a positive 
quantity for every nonzero column vector x T of dimension N. Matrix F is positive definite if and 
only if its principal minor determinants (or simply minors) are positive [1,2], that is, 


l/nI >0 


/ll /l2 

fill fill 


> 0 


/ll 

/l 2 /l3 


/11 • 

• f\N 

/21 

/31 

fll hi 
hi hi 

>0 

Zvi • 

■ Inn 


Evidently, like the original Schur-Cohn criterion, this criterion involves the evaluation of N deter¬ 
minants. However, the dimensions of the matrices involved now range from 1 x 1 to N x N and, 
therefore, the amount of computation is significantly reduced. 

It should be mentioned that matrix F is symmetrical with respect to both the main and cross 
diagonals, i.e., 


f'j = fj> ~ f(N+\-i)(N+l-j) = /(JV+WXiV+l-n 
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As a result, only the elements with subscripts i = 1 to K and / = + 1.... , N + 1 — i need to 

be computed where 


K = 


(N+D/2 

N/2 


for N odd 
for N even 


These are the elements covered by the triangle formed by three lines drawn through the first row, the 
main diagonal, and the cross diagonal. 


Example 5.6 


(a) A digital system is characterized by the transfer function 


H(z) = 


4 z 4 + 3z 3 + 2z 2 + z + 1 
Check the system for stability using the Schur-Cohn-Fujiwara criterion, (b) Repeat part (a) if 

z 2 + 2z + 1 


H(z) = 


z 4 + 6z 3 + 3s 2 + 4z + 5 


■ Solution 


(a) The denominator polynomial of the transfer function is given by 
D(z) = 4z 4 + 3z 3 + 2z 2 + z + 1 


Using Eq. (5.23), the Fujiwara matrix can be constructed as 


15 11 6 1 
11 23 15 6 
b ~ 6 15 23 11 

1 6 11 15 

The principal minors can be obtained as 


1151 = 15 


15 11 
11 23 


224 


15 11 6 
11 23 15 

6 15 23 


= 2929 


15 11 6 1 
11 23 15 6 
6 15 23 11 
1 6 11 15 


27,753 


and since they are all positive, the system is stable. ■ 
( b ) In this case 


D(z) = z 4 + 6z 3 + 3z 2 + 4z + 5 
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and hence Eq. (5.23) gives 

\fn\=bl- b\ = - 24 

i.e., the principal minor of order 1 is negative, and the system can be classified as unstable. 
There is no need to compute the remaining principal minors because a matrix cannot be 
positive definite if any one of its principal minors is zero or negative. ■ 


A simplified version of the Schur-Cohn stability criterion was described by Jury in 1962 [6] 
(see also Chap. 3 of Ref. [3]) and a simplified version of the Schur-Cohn-Fujiwara criterion was 
described by Anderson and Jury in 1973 [7]. 


5.3.7 Jury-Marden Stability Criterion 

A stability criterion that has been applied widely through the years is one developed by Jury during 
the early sixties [3] using a relation due to Marden [8] that gives the Schur-Cohn determinants in terms 
of second-order determinants. This criterion is often referred to as the Jury-Marden criterion and, 
as is demonstrated below, it is both very efficient and easy to apply. In this criterion, the coefficients 
of D(z), which are assumed to be real, are used to construct an array of numbers known as the Jury- 
Marden array, as in Table 5.1. The first two rows of the array are formed by entering the coefficients 
of I)(z) directly in ascending order for the first row and in descending order for the second. The 
elements of the third and fourth rows are computed as 


c i 


bi b N 
bu~i bo 


= bib 0 - b N _jb N 


for i = 0, 1, ... , N — 1 


Table 5.1 The Jury-Marden array 


Row 

Coefficients 

1 

bo 

b\ 

b 2 

b 3 


bn 

2 

bid 

^AT-l 

bN-2 

bN-3 


bo 

3 

co 

Cl 

C2 


Cat-1 


4 

Cat-i 

Cat-2 

Cat-3 


CO 


5 

do 

d\ 


dN-2 



6 

did-i 

du-2 


do 





2N — 3 

ro 

r\ 

r 2 

















220 DIGITAL SIGNAL PROCESSING 


those of the fifth and sixth rows as 


di = 


Q c a' — i 

Cn- 1 —i Co 


CiCo — cai_i_,cjv-i for i — 0, l, N — 2 


and so on until 2N — 3 rows are obtained. The last row comprises three elements, say, i'q . r \, and >' 2 - 
The Jury-Marden criterion states that polynomial I)(z) has roots inside the unit circle of the z 
plane if and only if the following conditions are satisfied: 


(i) 0(1) > 0 

(ii) (—1) JV £>(—1) > 0 

(iii) b 0 >\b N \ 

|col > |Cjv_i| 

Mol > \d-N-l\ 


kol > \ri\ 

As can be seen, the Jury-Marden criterion involves determinants of 2 x 2 matrices and is easy to 
apply even without the use of a computer. Note that all three of the preceding three conditions must 
be satisfied for the system to be stable. Therefore, the Jury-Marden array need not be constructed 
if either of conditions (i) or (ii) is violated. If these conditions are satisfied, then one can begin 
evaluating the elements of the Jury-Marden array. If a row is encountered where the magnitude of 
the first coefficient is equal to or less than the magnitude of the last coefficient, then the construction 
of the array can be terminated and the system declared unstable. 

Thus to save unnecessary effort, conditions (i) and (ii) should be checked first. If they are 
satisfied, then one can proceed with the Jury-Marden array. 


Example 5.7 


Check the systems of Example 5.6, parts (a) and ( b ), for stability using the 
Jury-Marden criterion. 


■ Solution 

(a) We have 

D(l) = 11 (—1) 4 Z)(—1) = 3 

and thus conditions (i) and (ii) are satisfied. The Jury-Marden array can be constructed 
as shown in Table 5.2 and since bg > \b\\, |cq| > |C 3 1, |c/o| > | d?\, condition (iii) is also 
satisfied and the system is stable. ■ 

( b) In this case 

(- 1 ) 4 £>(- 1 ) = -1 

i.e., condition (ii) is violated and the system is unstable. ■ 
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Table 5.2 Jury-Marden array for Example 5.7 


Row 

Coefficients 

1 

4 

3 

2 

1 

1 

2 

1 

1 

2 

3 

4 

3 

15 

11 

6 

1 


4 

1 

6 

11 

15 


5 

224 

159 

79 




Example 5.8 


A discrete-time system is characterized by the transfer function 


H(z) = 


lz 4 + 3z 3 + mz 2 + 2z + 1 


Find the range of m that will result in a stable system. 


■ Solution 


The transfer function can be expressed as 


H(z) = 


N(z) 

D(z) 


where 


D(z) — lz A + 3 z 3 + mz 2 + 2z + 1 

The stability problem can be solved by finding the range of m that satisfies all the 
conditions imposed by the Jury-Marden stability criterion. 

Condition (i) gives 


D(l) = 7 + 3 + ffi+2+l>0 


or m > —13 (5.24) 

From condition (ii), we have 

(-1) 4 £)(—!) = 7 —3 + m —2+ 1 > 0 
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Table 5.3 Jury-Marden array for Example 5.8 


Row 

Coefficients 

1 

7 

3 

m 

2 

1 

2 

1 

2 

m 

3 

7 

3 

48 

19 

6 m 

11 


4 

11 

6 m 

19 

48 


5 

2183 

912 — 66 m 

288m - 209 




or m > —3 (5.25) 

The Jury-Marden array can be constructed as shown in Table 5.3. 

Hence for stability, the conditions 

7 > 1 |48| > 1111 |2183| > |288m-209| 

must be satisfied. The third condition is satisfied if 

2183 > ±(288m - 209) 


i.e.. 



which implies that 


m > —6.8542 


or m < 8.3056 


(5.26) 


Now for stability all the Jury-Marden conditions must be satisfied and thus from Eqs. (5.24)- 
(5.26), the allowable range of m is obtained as 

—3 < m < 8.3056 ■ 


5.3.8 Lyapunov Stability Criterion 

Another stability criterion states that a discrete-time systems characterized by a state-space repre¬ 
sentation is stable if and only if for any positive definite matrix Q, there exists a unique positive 
definite matrix P that satisfies the Lyapunov equation [9] 


A r PA - P = -Q 
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In this criterion, a positive definite matrix Q is assumed, say Q = I, and the Lyapunov equation is 
solved for P [10]. If P is found to be positive definite, the system is classified as stable. This criterion 
is less practical to apply than the Jury-Marden criterion and, as a consequence, it is not used for 
routine analysis. Nevertheless, it has some special features that make it suitable for the study of 
certain parasitic oscillations that can occur in digital filters (see Sec. 14.9). 


5.4 TIME-DOMAIN ANALYSIS 

The time-domain response of a discrete-time system to any excitation x(n T ) can be readily obtained 
from Eq. (5.1) as 


y(nT) = Z-'\H(z)X(z)] 

Any one of the inversion techniques described in Sec. 3.8 can be used. 


Example 5.9 


Find the unit-step response of the system shown in Fig. 


5.4. 


■ Solution 

From Example 5.3 


H(z) = 


z 2 - z + 1 

(z - Pi)(z - Pi) 


where 


1 g-jx /4 


Pl ~ 2 J ~ 2 ~ V2 


and p 2 =l+jl = 


e-i */ 4 

"7T 


and from Table 3.2 


X(z) = 


z - 1 


On expanding H(z)X(z)/z into partial fractions, we have 

z - 1 z - Pi z- Pi 

where 


Rq = 2 R i = 


e j 5jt/4 

"7T 


and Ri = R\ = 


~j 5jt/4 

"7T 
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Hence 


y(nT) = Z~ 1 [H(z)X(z)] 

1 

= 2 u(nT) ■ 

= 2 u{nT) - 


( V 2)"+ 1 

1 


u(nT)(e j(n ~ 5)3!l4 + e - j(n ~ 5)n/4 ) 


-u(nT) cos 


y(nT) 


( V 2)”" 1 

The unit-step response of the system is plotted in Fig. 5.5. 
2.4 

) 

1.8 - 

1.2 - 

0.6 

0 


(n - 5)- 


jr 


nr 


Figure 5.5 Unit-step response (Example 5.9). 


5.5 FREQUENCY-DOMAIN ANALYSIS 

The response of a first-order discrete-time system to a sinusoidal excitation was examined in Sec. 4.5 
and it was found to comprise two components, a transient and a steady-state sinusoidal compo¬ 
nent. We will now show that the same is also true for the response of a system of arbitrary 
order. If the system is stable, the transient component tends to diminish rapidly to zero as time 
advances and in due course only the sinusoidal component prevails. The amplitude and phase an¬ 
gle of the sinusoidal output waveform produced by a sinusoidal waveform of unit amplitude and 
zero phase angle turn out to be functions of frequency. Together they enable one to determine the 
steady-state response of a system to a sinusoidal waveform of arbitrary frequency or the response 
produced by arbitrary linear combinations of sinusoidal waveforms, and can be used, in addition, to 
find the responses produced by complex waveforms. 

5.5.1 Steady-State Sinusoidal Response 

Let us consider a causal system characterized by the transfer function of Eq. (5.13). The sinusoidal 
response of such a system is 


y(nT) = 2- 1 [H(z)X(z )] 


z sincuT 

(z — ei a,T )(z — e - ^ r ) 


where 


X(z) = Z[u(nT) sin conT] = 


(5.27) 
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or 


y(nT) = —'-r / H(z)X(z)z" 1 dz 

2 ttj Jr 

= y Wes[H(z)X(z)z n - 1 ] (5.28a) 

All poles 


Assuming that the poles of the system are simple, then for n > 0 Eqs. (5.27) and (5.28a) yield 


y(nT) = dies [H(z)X(z)z‘ 

z=e ja,T 


n— In 


dies [H(z)X(z)z 

7 - e -jcoT 


N 

n ~ l ] + Y j dles[H(z)X{z)z n - x ] 

tt z=Pi 


= —[H(e ja>T )e jamT 

2 j 


N 

- H(e- ]aT )e- J0jnT ] + Y dles[H(z)X(z)z n ~ 1 ] 

tT z=p ‘ 


(5.28b) 


and if we let p, = the summation part in the above equation can be expressed as 

N N 

y dles[H(z)X(z)z n ~ 1 ] = y X( Pi ) P y dies H(z) 

z ' Z=Pi z ' Z—Pi 

1=1 i= 1 

(see Prob. 5.9). Now if the system is stable, then \p,\ = r, < 1 for i = 1, 2,..., N and hence as 

n —> oo, we have r" _1 -» 0. Thus /?" _1 = -» 0 and, therefore. 


v JV 

lim V dles[H{z)X(z)z n _1 ] = lim V X( Pi )p"~' dies H(z) 0 (5.28c) 

«—>-oo ^^ Z=p,- n—>-00 ^ Z=/?i 

i=l i=l 

Hence, Eqs. (5.28b) and (5.28c) give the steady-state sinusoidal response of the system as 

yitiT) = lim y{nT) = — \H(e j<aT )e i ‘ onT - H(e~ iolT )e~ imT ) (5.28d) 

n—>oo '2 j L J 

This result also holds true for systems that have one or more higher-order poles (see Prob. 5.28) 
as well as for noncausal systems as can be easily demonstrated. 

From the linearity of complex conjugation, the sum of a number of complex conjugates is equal 
to the complex conjugate of the sum, and if we use the z transform, we obtain 


oo 

H{e~ j(oT ) = y h(nT)e ja>nT 

n=—o o 


oo 

y h(nT)e- janT 

n=—o o 


H*(e ja,T ) 


(5.28e) 


If we let 


H(e jcoT ) = M(co)e m(0) 


where 


M(co) = \H(e jloT )\ and Q{m) = arg H(e jcoT ) 


(5.29) 
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then from Eqs. (5.28d) and (5.28e), the steady-state response of the system can be expressed as 
y(nT) = 1 f H(e jo,T )e jo>nT - H*(e jo,T )e~ ja)nT ] 

2 j 

= — [M(.af)e i[o>nT+Bm - M(^)e~ RanT+em ] 

2 j 

= M(co) sin[a>n T + 6{co)] (5.30) 


Clearly, the effect of a system on a sinusoidal excitation is to introduce a gain M(w) and a phase 
shift 9(a>), as illustrated in Fig. 5.6. As functions of frequency, Mio>) and (Ha)) are known as the 
amplitude and phase responses and function //(e 7 '" 7 ) from which they are derived is referred to as 
th e frequency response of the system. 2 

As may be recalled from Sec. 3.9.1, the frequency spectrum of a discrete-time signal is the z 
transform of the signal evaluated on the unit circle of the z plane. Since H (z) is the z transform of the 
impulse response, it follows that H(e ,mT ) is also the frequency spectrum of the impulse response. 


2 Some people refer to M(a>) as the magnitude response for obvious reasons. 
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That is, function H(e J "‘ T ) has a dual physical interpretation, namely, it is the frequency response of 
the system or the frequency spectrum of the impulse response. 

In digital filters, the gain often varies over several orders of magnitude as the frequency is varied 
and to facilitate the plotting of the amplitude response, the gain is usually measured in decibels (dB) as 

Gain = 201og 10 M(co) 

The gain in filters is typically equal to or less than unity and it is usually convenient to work 
with the reciprocal of the gain, which is known as attenuation. Like the gain, the attenuation can be 
expressed in dB as 


1 

Attenuation = 201og 10 - 

M(w) 


-20 log 10 M(co) 


The phase shift is measured either in degrees or in radians. 


5.5.2 Evaluation of Frequency Response 

The above analysis has shown that the amplitude and phase responses of a system can be obtained 
by evaluating the transfer function H(z.) on the unit circle |z| = 1 of the z plane, which is very much 
what we do to find the amplitude and phase spectrums of a discrete-time signal. This can be done 
very efficiently by using MATLAB or other similar digital signal processing (DSP) software. It can 
also be done by using a graphical method as will be demonstrated below. The method is inefficient 
and is unlikely to be used in practice, yet it merits consideration because it reveals some of the basic 
properties of discrete-time systems and provides, in addition, intuitive appreciation of the influence 
of the zero and pole locations on the amplitude response of a system. 

Let us consider a general transfer function expressed in terms of its zeros and poles as in 
Eq. (5.4). The frequency response of the system at some frequency a>, can be obtained as 

H(z) \ z ^ e j»r = H(e jmT ) = M{(o)e j6(<o) 

= H 0 YlU{e* T -ztf" 

Y\i=M ]a,T - Pi)' li 

and by letting 

e jmT - Zi = M Zi e j ^‘ 


(5.31) 

(5.32) 

(5.33a) 


we obtain 


e j0,T - Pi = M Pi e j +* 


, itfoinf=i k 

M(a>) = -5- 

nf=, 


e(w) = arg H 0 + ^ ^ n^/ p 


i =1 


(5.33b) 


(5.34) 


(5.35) 
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Figure 5.7 Graphical evaluation of frequency response of a discrete-time system. 

where arg Hq = n if Ho is negative. Thus M(a>) and 0(a)) can be determined graphically through 
the following procedure: 

1. Mark the zeros and poles of the system in the z plane. 

2. Draw the unit circle z — 1 • 

3. Draw complex number (or vector) e J "‘ T where o> is the frequency of interest. 

4. Draw m, complex numbers of the type given by Eq. (5.33a) for each zero of H (z) of order m,-. 

5. Draw ;t, complex numbers of the type given by Eq. (5.33b) for each pole of order 

6. Measure the magnitudes and angles of the complex numbers in Steps 4 and 5 and use Eqs. (5.34) 
and (5.35) to calculate the gain M(a >) and phase shift Q(oS), respectively. 

The procedure is illustrated in Fig. 5.7 for the case of a second-order discrete-time system with 
simple zeros and poles. The amplitude and phase responses of a system can be obtained by repeating 
the above procedure for a number of frequencies in the range of interest. 

5.5.3 Periodicity of Frequency Response 

Point A in Fig. 5.7 corresponds to zero frequency, point C corresponds to half the sampling frequency, 
i.e.,a> s /2 — tx /T , which is often referred to as the Nyquist frequency, and one complete revolution of 
vector e-i '" 1 about the origin corresponds to an increase in frequency equal to the sampling frequency 
co s = 2 tc/T rad/s. 

If vector e 1 " 1 ' 1 in Fig. 5.7 is rotated k complete revolutions, the vector will return to its original 
position and the values of M(o>) and 0(o>) will obviously remain the same as before. As a result 


H(e i{l0+k<0s)T ) = H(e jo>T ) 
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We conclude, therefore, that the frequency response is a periodic function of frequency with a 
period co s . 


5.5.4 Aliasing 

The periodicity of the frequency response can be viewed from a different perspective by examining 
the discrete-time sinusoidal signal given by 

x(nT ) = sin[(® + kco s )nT] 


Using the appropriate trigonometric identity, we can write 


x(nT) = sin conT cos kco s nT + cos conT sin kco s nT 

= sin conT cos ( k ■ — ■ nT ) + cos conT sin ( k ■ 



— sin conT cos 2knn + cos conT sin2kmt 
= sin conT 


We conclude that discrete-time signals sin(a> + kco s )nT and sin conT are numerically identical for 
any value of k as illustrated in Fig. 5.8. Consequently, if signal s\n(o) + ka> s )t is sampled at a sampling 
rate of co s , the sampled version of sin cot will be obtained and the frequency of the signal will appear 
to have changed from o> + kco s to a>. This effect is known as aliasing since frequency o> + kco s is 
impersonating frequency co. Now if the frequency of the sinusoidal input of a discrete-time system 
is increased from co to co + kco s , the system will obviously produce the same output as before since 
the two input signals will, after all, be numerically identical. 

Another facet of aliasing can be explored by considering a sinusoidal signal whose frequency 
is in the range ( k — ^)<y s to kco s where k is an integer, say, frequency kw s — co, where Q < co < w s /2. 


sin umT 



Figure 5.8 


Plots of sin(o;«r) and sin[(a> + a> s )nT] versus nT. 
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In this case, the signal can be expressed as 


x(jiT ) 


mu i k '•!, — co)nT 

sin kca s nT cos con T — cos kco s nT sin conT 


2i r 


sin \ k ■ — ■ n T ) cos con T — cos k ■ — 


2 7T 


sin 2knit cos conT — cos 2kmt sin conT 
— sin oonT = sin (—conT) 



sin con T 


Consequently, a positive frequency kco s — o> in the range (k — |)o> s to kco s will be aliased to the 
negative frequency — co. 

The above analysis demonstrates that the highest frequency that can be present in a discrete-time 
sinusoidal signal is co s /2. If a continuous-time signal has sinusoidal components whose frequencies 
exceed co s /2, then the frequencies of any such components will be aliased. This can cause some 
serious problems as will be demonstrated in Chap. 6. 

The effects of aliasing can be demonstrated in a different setting that is very familiar to movie 
fans. As the cowboy wagon accelerates into the sunset, the wheels of the wagon appear to accelerate in 
the forward direction, then reverse, slow down, stop momentarily, and after that they accelerate again 
in the forward direction. This series of events happen in the reverse order if the wagon decelerates. 
Actually, this is exactly what we should see, it is not an illusion, and it has to do with the fact that 
the image we see on the screen is a series of still photographs which constitute a sampled signal. 
The phenomenon is easily explained by the illustrations in Fig. 5.9. In this context, the sampling 
frequency co s is the number of film frames per second as taken by the movie camera and the number 
of wheel revolutions per second defines the frequency of a signal component. Let us examine what 
happens as the number of wheel revolutions is increased from 0 to 5« v /4. In Fig. 5.9 a, the wheel 
revolves at a speed co s /4 and the marker will thus move a quarter revolution before the next frame. 
The wheel appears to be rotating in the clockwise direction. In Fig. 5.9 b, the wheel revolves at a 
speed cd s /2 and the marker will thus move half a revolution before the next frame. If this speed were 
maintained, the viewer would have difficulty discerning the direction of rotation since the marker 
on the wheel would alternate between the top and bottom. In Fig. 5.9c, the wheel revolves at a 
speed 3^/4 and the marker will thus move three-quarters of a revolution before the next frame. 
Miraculously, the wheel will appear to turn in the counterclockwise direction at co s /4 revolutions per 
second. This is analogous to the situation where a frequency of a sinusoidal signal in the range co s /2 
to co s is aliased to a negative frequency. Increasing the rotation speed to, say, 7co s /8 as in Fig. 5.9 d, 
the wheel will appear to rotate slowly in the reverse direction and if the rotation speed is exactly co s , 
the wheel will appear to stop as can be seen in Fig. 5.9e, that is, the sampling frequency will appear 
to behave very much like zero frequency. 3 If the speed of the wheel is increased a bit more, say, to 
9co s /&, then the wheel will appear to move slowly in the forward direction, as depicted in Fig. 5.9/, 


^This is actually the basis of the stroboscope which is an instrument that can be used to measure the speed in motors 
and other machinery. 
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Figure 5.9 Aliasing at the movies. 


and at a speed of 5m s /A the wheel will appear to rotate at the rate of co s /4 revolutions per second as 
depicted in Fig. 5.9a, that is, back to square one. This analogy provides a visual demonstration as 
to why the signals sin(o> + kco s )nT and sin conT cannot be distinguished, on the one hand, and why 
the highest frequency in a discrete-time signal cannot exceed a> s / 2. 
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5.5.5 Frequency Response of Digital Filters 

In view of the periodicity of the frequency response, a discrete-time system is completely specified 
in the frequency domain by its frequency response over the frequency range —a> s /2 < co < co s /2 
which is known as the baseband. In Chap. 1, four types of filters were described, namely, lowpass, 
highpass, bandpass, and bandstop, depending on the range of frequencies selected or rejected. In 
discrete-time systems such as digital filters, these terms are applied with respect to the positive half of 
the baseband, e.g., a highpass filter is one that will select frequencies is some range a> p < co < co s /2 
and reject frequencies in some range 0 < co < co a , where co a < a> p . 

The magnitude of H(z) is a surface over the z plane. From Eq. (5.4), since z —> Zi, //(") —> 0 
since (z — Zi) —> 0. On the other hand, as z —> Pi, |//(z)| —> oo since (z — pj) -* 0. After all, Zi is a 
zero and p, is a pole. So if a zero Zi = r Zi e^ z ‘ is located close to the unit circle, then the gain of the 
system at frequencies close to </>-. / T will be very small. On the other hand, if a pole p, — r p . e^ p ‘ is 
located close to the unit circle, then the gain of the system will be large at frequencies close to (p p . /T. 
On the basis of these observations, one can easily visualize the amplitude response of a system by 
simply inspecting its zero-pole plot. If the poles are clustered in the region near the point (1,0) and 
the zeros are clustered near the point (— 1, 0), then the system is a lowpass filter. More precisely, a 
system is a lowpass filter if the poles and zeros are enclosed in the sectors — <t> p < <p Pi < <t> p and 
— <J>, > (j) Zi > <t> z , respectively, where 0- and <P p are positive angles such that <f> /; < <f> :: < tt . On 
the basis of these principles, the system represented by the zero-pole plot of Fig. 5.10a should be a 
lowpass filter and this, indeed, is the case as can be seen in the 3-D plot of Fig. 5.10b. 

The angle of // (z) is also a surface over the z plane but, unfortunately, this is usually far too 
convoluted to be correlated to the zero-pole plot. See, for example, the 3-D plot of Fig. 5.10c, which 
represents the angle of H(z) for the lowpass filter under consideration. 

The amplitude and phase responses could be displayed in terms of 3-D plots, as depicted in 
Fig. 5.10c/ and e, by evaluating the magnitude and angle of H(z) on the unit circle, i.e., by letting 
Z = e , “ 7 . If the surfaces in Fig. 5.10b and c were deemed to represent solid objects, say, made of 
wax, then the amplitude and phase responses would be the profiles of the cores punched through 
these objects by a cylindrical corer tool of radius 1. Three-dimensional plots such as these are both 
difficult to plot as well as visualize, particularly, the one for the phase response. For these reasons, 
the amplitude and phase responses are usually plotted in terms of 2-D plots of 20 log M(o>) and 0(o>), 
respectively, as illustrated in Fig. 5.10/ and g. To continue the geometrical interpretation, these 2-D 
plots can be obtained by spreading ink over the surfaces of the wax cores obtained before and then 
rolling them over a white sheet of paper. 

It should be mentioned here that ambiguities can arise in the evaluation of the phase response 
owing to the fact that 9 = tan -1 p is a multivalued function of p, (see Sec. A.3.7). Typically, one 
would evaluate the phase response of a system by finding the real and imaginary parts of the frequency 
response, i.e., 


H(e ja>T ) = me H(e jmT ) + j 3m H(e ja,T ) 


and then compute the phase response as 


0(a>) = tan 1 


3m //(e- , “ r ) 


me H)ei aT ) 
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- 2-1 0 1 2 


SRcz 

(a) 




Figure 5.10 Frequency response of lowpass filter: ( a ) Zero-pole plot, (b) plot of 20log |//(z)| versus 
z = tHe z + j 3m z, (c) plot of arg H{z) versus z. 
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0 ) 

Figure 5.10 Cont’d Frequency response of lowpass filter: (d) Plot of 20log \H(e Jo>T )\ versus z, (e ) plot of 
arg H(e icoT ) versus z- 

Things would work out perfectly if —n < died) < n. However, if the value of 0(o>) is outside this 
range, the phase response computed by the typical DSP software, including MATLAB, would be 
wrong. The phase response of causal systems is a decreasing function of frequency because of certain 
physical reasons to be explained shortly and at some frequency it will decrease below — n. When this 
happens, the typical DSP software will yield a positive angle in the range 0 to tc instead of the correct 
negative value, i.e., an angle it — e will be computed instead of the correct angle of — n — e; thus 
an abrupt discontinuity of +2n will be introduced as an artifact. This problem can be corrected by 
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Figure 5.10 Cont’d Frequency response of lowpass filter: (/) Plot of 20 log M(a>) versus cu, (g) plot of 
9(a >) versus a>. 

monitoring the change in the phase response as the frequency is increased and whenever a sign change 
is observed in the phase response from a negative to a positive value, which corresponds to a crossing 
of the negative real axis, to subtract an angle of 2tx from the phase response at that frequency as well 
as all the subsequent frequencies (see Sec. A.3.7). This problem is quite apparent in the 3-D and 2-D 
plots of Fig. 5.1 Oe and g, which were computed with MATLAB using function atan2. The corrected 
phase responses are depicted in Fig. 5.10/z and i. Incidentally, the phase response continues to have 
discontinuities after correction but these are legitimate. They are caused by the zeros in Fig. 5.10 a. 
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Figure 5.10 Cont’d Frequency response of lowpass filter: ( h ) Corrected plot of arg H(e^ wT ) versus z, (i) 
corrected plot of 9(a>) versus a>. 


Example 5.10 


The discrete-time system shown in Fig. 5.11 is a nonrecursive filter. The 
multiplier constants are 


A 0 = 0.3352 A\ = 0.2540 A 2 = 0.0784 
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Figure 5.11 Fourth-order, nonrecursive filter (Example 5.10). 


and the sampling frequency is co s — 20 rad/s. (a) Construct the zero-pole plot of the filter. 
(b) Plot the surface H (z) as a function of z = (He z + j 3m z. (c) Obtain expressions for the 
amplitude and phase responses. ( d ) Plot the amplitude and phase responses first in terms of 
3-D plots and then in terms of 2-D plots. 


■ Solution 


(a) The transfer function of the filter can be readily obtained by inspection as 


A 2 + A 1 Z 1 + Aqz 2 + A\z 3 + A 2 Z 4 

(5.36a) 

A 2 z 2 + Aiz + A 0 + Aiz -1 + A 2 z~ 2 
z 2 

(5.36b) 

A 2 z 4 + Aiz 3 + A 0 z 2 + Aiz + A 2 

_4 

(5.36c) 


From Eq. (5.36c), we note that the filter has four zeros and a fourth-order pole at the 
origin. Using MATLAB, the zeros can be obtained as 


zi = -1.5756 Z 2 = -0.6347 z 3 , z 4 = -0.5148 ± ;'0.8573 

Hence the zero-pole plot of Fig. 5.12a can be obtained. We note that the high-order 
pole at the origin tends to create high gain at low frequencies, whereas the zeros tend to 
produce low gain at high frequencies. Thus, the system must be a lowpass filter. ■ 
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!Kc Z 

(a) 



Figure 5.12 Frequency response of lowpass filter (Example 5.10): (a) Zero-pole plot, ( b ) plot 
of 20 log | H(z)\ versus z = SKe z + j 3m z. 

(. b ) The 3-D plot of 20 log fl(z)\ versus z is shown in Fig. 5.12 b. 

(c) From Eq. (5.36b), we have 

ja>T% A 2 (e j2a>T + e~^ T ) + A x {e^ T + e~^ T ) + A 0 

H{e )= - eJ^of - 

2 A 2 cos 2 coT + 2 Ax cos a>T + Aq 

e j2a)T 
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Figure 5.12 Cont’d Frequency response of lowpass filter (Example 5.10): (c) Plot of 
20 log \H{e ialT )\ versus z, (d) corrected plot of arg H(e iwT ) versus z . 
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Frequency, rad/s 
(e) 



Frequency, rad/s 
(/) 


Figure 5.12 Cont’d Frequency response of lowpass filter (Example 5.10): (e) Plot of 
20 log M(co) versus a>, (/) corrected plot of 9(a>) versus a>. 
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and so 


where 


M(co) = |2A2COs2a>r + 2A\ cos a>T + Ao| ■ 
9(co) — On — 2 coT ■ 

f 0 if 2 A 2 cos 2 a>T + 2 A \ cos coT + Aq > 0 
1 7 r otherwise 


(d) The amplitude and phase responses are depicted in Fig. 5.12c and d as 3-D plots and 
in Fig. 5.12e and / as 2-D plots. ■ 


An interesting property of nonrecursive filters is that they can have a linear phase response, as 
can be seen in Fig. 5.12/. This is an important feature that makes nonrecursive filters attractive in a 
number of applications. 


Example 5.11 


A recursive digital filter is characterized by the transfer function 


3 

H(z) = H () [] Hdz) 

1=1 


where 


Hi{z) 


am + auz + z 2 
bm + b u z + z 2 


and the numerical values of the coefficients are given in Table 5.4. The sampling frequency is 
20 rad/s. (a) Construct the zero-pole plot of the filter, ib) Plot the surface // (/) as a function 
of z = Die z + j 3m z. (c) Obtain expressions for the amplitude and phase responses, (d) Plot 
the amplitude and phase responses first in terms of 3-D plots and then in terms of 2-D plots. 


Table 5.4 Transfer-function coefficients for Example 5.11 


i 

am 

d\i 

boi 

bu 

1 

-1.0 

0.0 

8.131800E—1 

7.870090E—8 

2 

1.0 

-1.275258 

9.211099E—1 

5.484026E—1 

3 

1.0 

1.275258 

9.211097E—1 

—5.484024E—1 


H 0 = 

1.763161E - 

2 
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■ Solution 

(a) The zeros and poles of the transfer function can be readily obtained as 

zi,z 2 = ±l z 3 ,Z4 = 0.6376 ± ;0.7703 
z 5 ,ze = -0.6376 ± y'0.7703 

and 


PuP2 = ±70.9018 Pi, P 4 = 0.2742 ± jO.7703 
p 5 ,p 6 = -0.2742 ± j 0.7703 


respectively. Hence the zero-pole plot depicted in Fig. 5.13a can be readily constructed. 
Since there is a cluster of poles close to the unit circle at coT ~ n/2 and zeros at (1, 0) 
and (— 1, 0), the recursive filter must be a bandpass filter which will select frequencies 
closed to m = 7r/2r. ■ 

(b) The 3-D plot of 20log \H(z)\ versus z depicted in Fig. 5.13 b demonstrates clearly 
that this is a bandpass filter. ■ 

(c) The frequency response of the filter can be obtained as 


with 


and 


H(z) | z ^ e MT = H(e jloT ) = M(co)e Ma) 


3 

M(a>) = IHoini^) 

1=1 


3 

i=i 


0(co) = arg H 0 + ^2 ar S H i(e jmT ) = ^ #;(«) 


1 = 1 


1 = 1 


Mi(a>) = H,(e jmT ) 


a 0i + a u e J0/r + e j2loT 
b 0i + b u e^ T + ei 2loT 


(aoi + an cos coT + cos2 coT) + j (an sin a>T + sinlcuT) 

(boi + bn cos wT + cos 2 coT) + j(bn sin wT + sin 2 a>T) 

t 

(aoi + an cos a>T + cos 2 a>T) 2 + (an sinaiT + sin 2 coT) 2 2 
(boi + bu cos coT + coslcoT) 2 + (bn si ncoT + sin 2 coT) 2 _ 

t 

1 + ah + a 2 t + 2(1 + aoi)au cos coT + 2ao; cos 2 coT' 2 
1 + b} H + b\ t + 2(1 + boi )b\i cos coT + 2bot cos 2 coT 


where 
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- 2-1 0 1 2 


(a) 



(b) 

Figure 5.13 Frequency response of bandpass filter (Example 5.11): (a) Zero-pole plot, 

(b) plot of 20 log | H(z) I versus z = (He z + j 3m z. 

and 

0 ,M = argtf i (e> 7 ') 

a 0i + a u e ja,T + e j2wT 
~ ar§ b 0i + b u ej (aT + ei 2mT 

(ciQi + au coscoT + cos2 coT) + j(au sin coT + sin2a>T ) 

= arg--- 

(bo, + b i,- coscoT + cos2coT) + j(bu sin mT + sin2&>r) 
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(C) 



Figure 5.13 Cont’d Frequency response of bandpass filter (Example 5.11): (c) Plot of 
20log \H(e iolT )\ versus z, ( d ) corrected plot of arg \H(e-' wT )\ versus z. 

an sincoT + sin2a>T 

= tan -- 

dQj + au cos coT + cos 2 u>T 

j bn sin cur + sin2&>r 

— tan - ■ 

boi + bu cos coT + cos 2 coT 

The 3-D plots for the amplitude and phase responses are depicted in Fig. 5.13c and 
d and the corresponding 2-D plots can be readily obtained from the above expressions as 
shown in Fig. 5.13c and /. As can be seen from these plots, the system being analyzed 
is definitely a bandpass filter. ■ 
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Frequency, rad/s 

(e) 



Figure 5.13 Cont’d Frequency response of bandpass filter (Example 5.11): (e) Plot of 
20 log M(id) versus a>, (/) corrected plot of 9(a) versus a. 


5.6 TRANSFER FUNCTIONS FOR DIGITAL FILTERS 

In the previous section, we have demonstrated that the filtering action of a discrete-time system 
depends critically on the patterns formed by the zeros and poles of the transfer function in the z 
plane. In this section, we show that a set of standard low-order transfer functions can be derived 
through the judicious choice of the zero/pole locations. 
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5.6.1 First-Order Transfer Function 

A first-order transfer function can only have a real zero and a real pole, i.e. it must be of the form 


H{z) = 


z - ZO 

Z - Po 


and to ensure that the system is stable, the pole must satisfy the condition — 1 < po < 1. The zero 
can be anywhere on the real axis of the z plane. If the pole is close to point (1,0) and the zero is close 
to or at point (— 1, 0), then we have a lowpass filter; if the zero and pole positions are interchanged, 
then we get a highpass filter. 

Certain applications call for discrete-time systems that have a constant amplitude response and 
a varying phase response. Such systems can be constructed by using allpass transfer functions. A 
first-order allpass transfer function is of the form 


H(z) = 


Poz - 1 
z- po 


Po 


z - 1/po 

Z- Po 


where the zero is the reciprocal of the pole. The frequency response of a system characterized by 
H(z) is given by 

jaT _ ppe J0lT - 1 _ po cos coT + jp 0 sin wT - 1 
el a>1 — po cos coT + j sin u>T — po 


and hence the amplitude and phase responses can be obtained as 


M(oj) = 


po coscoT — 1 + jpo sin coT 
cos a>T — po + j sin a>T 


(po coscoT — l) 2 + (po sincuT) 2 2 
(cos wT — po) 2 + (sincuT) 2 


= 1 


and 


0(a>) = tan 1 


po sin wT 
po cos a>T — 1 


— tan 


sin a T 
cos wT — po 


respectively. 


5.6.2 Second-Order Transfer Functions 

LOWPASS TRANSFER FUNCTION. As was shown earlier, a system whose poles and zeros are 
located in the sectors — thp < (p Pi < <t> ; , and — <t>. > cf> Zi > <J>-, respectively, where <t> ; , and ch¬ 
are positive angles such that <J>- > <t> /; is a lowpass filter. Hence a lowpass second-order transfer 
function can be constructed by placing a complex-conjugate pair of poles anywhere inside the unit 
circle and a pair of zeros at the Nyquist point, as shown in Fig. 5.14n. Such a transfer function can 















THE APPLICATION OF THE Z TRANSFORM 


247 



91c z 
(a) 




( b ) 

Figure 5.14 Frequency response of second-order lowpass filter: (a) Zero-pole plot, ( b) amplitude and phase 
responses. 

be constructed as 


H lp {z) = 


(z + l ) 2 

(z — re^)(z — re~ M) 


z 2 + 2z + 1 

Z 2 — 2r(cos(/>)z + r 2 


(5.37) 


where 0 < r < 1 . As the poles move closer to the unit circle, the amplitude response develops a peak 
at frequency a> = (p/T while the slope of the phase response tends to become steeper and steeper at 
that frequency, as illustrated in Fig. 5.14 /t. 
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HIGHPASS TRANSFER FUNCTION. If the zeros and poles of a system are located in the sectors 


< <Pzi < and -<D P 


> <l>r, > 


where and <t> ; , are positive angles such that <J> p > O- 


then the system is a highpass filter. A highpass transfer function can be readily obtained form 
Eq. (5.37) by simply moving the zeros from point (—1, 0) to (1, 0) as in Fig. 5.15 a, that is, 

(z- l ) 2 (z 2 -2z+1) 


hpO £ 2 _ 2r(cos <p)z + r 2 z 2 — 2r(cos (p)z + r 2 
The amplitude and phase responses obtained are shown in Fig. 5.15£>. 


(5.38) 



(a) 




0 5 10 


Frequency, rad/s 
(b) 


Figure 5.15 Frequency response of second-order highpass filter: (a) Zero-pole plot, ( b ) amplitude and 
phase responses. 
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BANDPASS TRANSFER FUNCTION. In a bandpass system, a cluster of poles is sandwiched between 
clusters of zeros in the neighborhoods of points (1,0) and (—1, 0). A second-order bandpass transfer 
function can be obtained from the lowpass transfer function of Eq. (5.37) by moving one zero from 
point (—1, 0) to (1, 0), as shown in Fig. 5.16a. The transfer function assumes the form 


Hb p(z) 2 o/ ±\ i 2 

Z — 2r(cos <p)z + r z 


(5.39) 


and some typical amplitude and phase responses are shown in Fig. 5.16b. 



tH tz 
(a) 




C b ) 

Figure 5.16 Frequency response of second-order bandpass filter: (a) Zero-pole plot, ( b ) amplitude and 
phase responses. 
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NOTCH TRANSFER FUNCTION. A notch system is one that has a notch in its amplitude response, 
as may be expected, and such a response can be achieved by placing a complex-conjugate pair of 
zeros on the unit circle, as illustrated in Fig. 5.17a. The transfer function of such a system assumes 
the form 


z 2 — 2(cos ijr)z + 1 
Z 2 — 2r(cos (p)z + r 2 


(5.40) 


and as can be seen in Fig. 5.17b three types of behavior can be achieved depending on the relative 
location of the zeros in relation to the poles. If i/f > </;, then a lowpass notch filter is obtained and if </> > 
i jr, then a highpass notch is the outcome. The case, cj) = i// will yield a filter that will reject frequencies 
in the neighborhood of u> — <j>/T, and such a filter is usually referred to as a bandstop filter. 





(b) 


Figure 5.17 Frequency response of second-order notch filter (<p = rc/2): (a) Zero-pole plots, (b) amplitude 
and phase responses. 
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ALLPASS TRANSFER FUNCTION. An /Vth-order allpass transfer function with a denominator 
polynomial bo + b\z + ■ ■ ■ + b^-iz N ~ l + biyz N can be obtained by constructing a corresponding 
numerator polynomial b n + b^-iZ + ■ ■ ■ + b\z N ~ l + boZ N by simply reversing the order of the 
coefficients. Hence a second-order allpass transfer function can be obtained as 


_ r 2 z 2 - 2(cos <j>)z + 1 
AP Z z 2 — 2r(cos (p)z + r 2 


(5.41) 


As in the first-order allpass transfer function, the zeros of the second-order allpass transfer function 
are the reciprocals of the poles (see Prob. 5.31). To demonstrate that this is indeed an allpass transfer 
function, we note that 


M ap (o>) = \H AP (e iaT )\ = [H AP (e ja,T ) ■ H* p (e ja,T )\ ' 2 
= [H AP (e JMT ) ■ H AP (e- J0/r )] 2 


and hence 


l 

M AP (o>) = { [H ap (z) ■ H AP (z~ l )\ z=ejmT ) 2 


r r 2 z 2 + 2(cos <p)z + 1 


z 2 + 2r(coscp)z + r 2 


r 2 z 2 + 2(cos 4>)z 1 + 1 
z~ 2 + 2r(cos(/>)z _1 + r 2 


z=ei coT 


1 

2 


r r 2 z 2 + 2(cos <j>)z + 1 


z 2 + 2r(cos(/»)z + r 2 


r 2 + 2(cos <p)z + z 2 

1 + 2r(cos0)z + z 2 r 2 


z=e i<oT 


1 

2 


= 1 


As in the first-order allpass transfer function, the zeros of a second-order (also an /Vth-order) transfer 
function are the reciprocals of corresponding poles. 

As will be shown in the next section, a nonlinear phase response in a filter would lead to phase 
distortion which is undesirable in certain applications. Some of the design methods for recursive 
filters to be explored later on in Chap. 11 tend to yield filters with nonlinear phase responses. The 
phase responses of these filters can be linearized through the use of allpass systems known as delay 
equalizers (see Sec. 16.8). 


5.6.3 Higher-Order Transfer Functions 

Higher-order transfer functions can be obtained by forming products or sums of first- and/or second- 
order transfer functions. Methods for obtaining transfer functions that will yield specified frequency 
responses will be explored in later chapters. 

5.7 AMPLITUDE AND DELAY DISTORTION 

In practice, a discrete-time system can distort the information content of a signal to be processed as 
will now be demonstrated. 
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Consider an application where a digital filter characterized by a transfer function II (z) is to be 
used to select a specific signal Xk(nT ) from a sum of signals 

m 

x(nT) = Xj(nT) 

i= 1 


Let the amplitude and phase responses of the filter be M(a >) and (>(o>), respectively. Two parameters 
associated with the phase response are the absolute delay r a (a>) and the group delay r g (a)) which are 
defined as 


d(w) 

ra(co) = 

CO 

(5.42a) 

d6{oo) 

r > ( " ,= do, 

(5.42b) 


As functions of frequency, r a (co) and r g (a>) are known as the absolute-delay and group-delay char¬ 
acteristics. 

Now assume that the amplitude spectrum of signal Xk(nT) is concentrated in frequency band 
B given by 


B = {w : u>l < a> < cl>h } 


as illustrated in Fig. 5.18. Also assume that the filter has amplitude and phase responses 


and 



for a> e B 
otherwise 


(5.43) 


0(co) = —T g co + 0o for to e B 


(5.44) 


respectively, where Go and r g are constants. The z transform of the output of the filter is given by 

m m 

Y(z) = H(z)X(z ) = H(z)J2 x i(z) = J2 

i =1 i=l 



(e) 



Figure 5.18 Amplitude spectrum of a sum of signals. 
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and thus the frequency spectrum of the output signal is obtained as 

m 

Y(e ja>T ) = J2 H(e ] ' wT )X i (e ia>T ) 

1 = 1 
m 

= M(oj)e j0<a,) X,(e ja,T ) (5.45) 

1 = 1 

Hence from Eqs. (5.43)-(5.45), we have 

Y(e j0,T ) = G 0 e- ja,T ‘ +jeo X k (e jo,T ) 

since all signal spectrums except X k (e JmT ) will be multiplied by zero. If we let r g = mT where m 
is a constant, we can write 

Y{z) = G o e j0 °z- m X k (z) 


Therefore, from the time-shifting theorem of the z transform (Theorem 3.4), we deduce the output 
of the filter as 


y(nT) = Goe-i d °x k (nT — mT) 

That is, if the amplitude response of the filter is constant with respect to frequency band B and zero 
elsewhere and its phase response is a linear function of co, that is, the group delay is constant in 
frequency band B, then the output signal is a delayed replica of signal x k (nT) except that a constant 
multiplier Goe-i e ° is introduced. 

If the amplitude response of the system is not constant in frequency band B, then the so-called 
amplitude distortion will be introduced since different frequency components of the signal will 
be amplified by different amounts. On the other hand, if the group delay is not constant in band B, 
different frequency components will be delayed by different amounts, and delay (or phase) distortion 
will be introduced. Amplitude distortion can be quite objectionable in practice. Consequently, the 
amplitude response is required to be flat to within a prescribed tolerance in each frequency band 
that carries information. If the ultimate receiver of the signal is the human ear, e.g., when a speech 
or music signal is to be processed, delay distortion turns out to be quite tolerable. However, in 
other applications it can be as objectionable as amplitude distortion, and the delay characteristic is 
required to be fairly flat. Applications of this type include data transmission where the signal is to 
be interpreted by digital hardware and image processing where the signal is used to reconstruct an 
image which is to be interpreted eventually by the human eye. 

From Eq. (5.42a), we note that the absolute delay x a (a>) is constant if the phase response is 
linear at all frequencies. In such a case, the group delay is also constant and, therefore, delay distortion 
can also be avoided by ensuring that the absolute delay is constant. However, a constant absolute 
delay is far more difficult to achieve in practice since the phase response would need to be linear at 
all frequencies. 4 


4 This is why the absolute delay is hardly ever mentioned in DSP and communications textbooks. 
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PROBLEMS 

5.1. Derive the transfer functions of the systems in Fig. P4.5a and b. 

5.2. Derive the transfer functions of the systems in Fig. P4.6a and b. 

5.3. Derive the transfer functions of the systems in Fig. P4.7 and P4.8. 

5.4. A recursive system is characterized by the equations 

y(nT) = yfnT) + \y(nT - T) - f y{nT - 2T) 
yfnT) = x{nT) + \ydnT - T) 

Obtain its transfer function. 

5.5. A system is represented by the state-space equations 

q {nT + T) = Aq (nT) + bx(nT) 
y(nT) = c r q (nT) + dx(nT) 

where 


A = 

" 0 1 O' 

0 0 1 

1 11 

b = 

p o 


~2 2 2 


_ 1 _ 


Deduce its transfer function. 

5.6. Show that 


H(z) = 


Y.l 0 a,z M - 

z w + Ef=t ba N 


represents a causal system only if M < N. 

5.7. ( a ) Find the impulse response of the system shown in Fig. 5.2. 

( b ) Repeat part (a) for the system of Fig. 5.4. 

5.8. Obtain the impulse response of the system in Prob. 5.4. Sketch the response. 
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5.9. At z = Pi, F{z) is analytic and G(z) has a simple pole. Show that 

9to[F(z)G(z)] = F(p,)Dies G(z ) 

Z=Pi Z=Pi 

5.10. (a) In Sec. 5.3.1, it was shown that a system with simple poles is stable if and only if its poles are inside 

the unit circle of the z plane. Show that this constraint applies equally well to a system that has one 
or more second-order poles. 

( b ) Indicate how you would proceed to confirm the validity of the stability constraint in part (a) for the 
case where the system has one or more poles of order higher than two. 

5.11. Starting from first principles, show that 


H(z) = 


represents a stable system. 

5.12. (a) A recursive system is represented by 


H(z) = 

Check the system for stability. 

( b ) Repeat part (a) if 


6 z 6 + 5 z 5 + 4 z 4 + 3z 3 + 2z 2 + z + 1 


H(z) = 


(z + 2 ) 2 


6 z 6 + 5 z 5 — 4 z 4 + 3z 3 + 2z 2 + z + 1 

5.13. (a) Check the system of Fig. P5.13a for stability. 

( b ) Check the system of Fig. P5.13Z? for stability. 




Figure P5.13a and b 
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5.14. {a) A system is characterized by the difference equation 

y(nT) = x(nT) - \x{nT - T) - \x(nT - 2T) - \x(nT - 3 T) - \x(nT - AT) 

By using appropriate tests, check the stability of the system. 

C b ) Repeat part (a) for the system represented by the equation 

y(nT) = x(nT) - \y(nT - T) - \y(nT - 2 T) - \y{nT - 3 T) - \y{nT - AT) 

5.15. Obtain (a) the transfer function, ( b ) the impulse response, and (c) the necessary condition for stability 
for the system of Fig. P5.15. The constants m\ and m 2 are given by 

m 1 = 2rcos0 and m 2 = — r 1 



Figure P5.15 

5.16. A system is characterized by the transfer function 


H(z) = 


Az 4 + 3z 3 + mz 2 + z + 1 


Find the range of m that will result in a stable system. 

5.17. Find the permissible range for m in Fig. P5.17 if the system is to be stable. 


x(nT) 



Figure P5.17 
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5.18. 


5.19. 


5.20. 

5.21. 


5.22. 

5.23. 

5.24. 


5.25. 

5.26. 


5.27. 


A system is characterized by the transfer function 


H(z) = 


1 


z 2 + 


i 

4 


Derive an expression for its unit-step response. 

A system is characterized by the transfer function 


H(z) = 


(a) Find the response of the system at t = AT using the convolution summation if the excitation is 

x(nT) = (5 + n)u(nT) 

(, b ) Give a graphical construction for the convolution in part (a) indicating relevant quantities. 
Repeat part (a) of Prob. 5.19 using the general inversion formula in Eq. (3.8). 

A system is characterized by the transfer function 


H(z) = 


z 2 - z + 1 
z 2 - z + 0.5 


Obtain its unit-step response. 

Find the unit-step response of the system shown in Fig. 5.2. 

Find the unit-ramp response of the system shown in Fig. 5.4 if T = 1 s. 
The input excitation in Fig. 5.2 is 


{ n for 0 < n < 2 

4 — n for 2 < n < 4 

0 for n > 4. 

Determine the response for 0 < n < 5 by using the z transform. 

Repeat Prob. 4.24 by using the z transform. For each of the three cases deduce the exact frequency of the 
transient oscillation and also the steady-state value of the response if T = 1 s. 

A system has a transfer function 


(a) Find the response if 


H(z) = 


z 2 + \ 


x(nT) = u(nT) sin ainT 
( b) Deduce the steady-state sinusoidal response. 

A system is characterized by 


1 

(z - r ) 2 


W(z) = 
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y(nT) 


Figure P5.29 

where \r\ < 1. Show that the steady-state sinusoidal response is given by 

y(nT) = M(cu)sm[amT + 6(co)] 

where 

M{w)=\H(e jo]T )\ and 6»(w) = arg H(e ] ° >T ) 

5.28. (a) In Sec. 5.5.1 it was shown that the steady-state sinusoidal response of a system with simple poles is 

given by Eq. (5.30). Show that this equation is also valid for a system with one or more second-order 
poles. 

( b ) Indicate how you would proceed to show that Eq. (5.30) applies equally well to a system with one or 
more poles of order higher than two. 

5.29. Figure P5.29 depicts a nonrecursive system. 

(a) Derive an expression for its amplitude response. 

(, b ) Derive an expression for its phase response. 

(c) Calculate the gain in dB at a> = 0, Wj/4, and a> s /2 ( ai s is the sampling frequency in rad/s). 

(i d ) Calculate the phase-shift in degrees at id = 0, a> s / 4, and co s /2. 

5.30. The discrete-time signal 

x{nT) = u(nT) sin omT 

is applied to the input of the system in Fig. P5.30. 

(a) Give the steady-state time-domain response of the system. 

( b ) Derive an expression for the amplitude response. 

(c) Derive an expression for the phase response. 

(. d ) Calculate the gain and phase shift for id = rad/s. 



5.31. Show that the poles of the allpass transfer function in Eq. (5.41) are the reciprocals of the zeros. 

5.32. Figure P5.32 shows a nonrecursive system. 

(a) Derive expressions for the amplitude and phase responses. 

( b ) Determine the transmission zeros of the system, i.e., zero-gain frequencies. 
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(c) Sketch the amplitude and phase responses. 



5.33. 


5.34. 

5.35. 


Filter 

i 

«o; «i; bat bu 

A 

1 

2 

2.222545 E - 1 -4.445091F - 1 4.520149F - 2 1.5618334? - 1 

3.085386F - 1 -6.170772F - 1 4.509715F - 1 2.1681714? - 1 


o 

II 

Sq 

B 

1 

2 

5.490566 9.752955 7.226400F - 1 4.944635F - 1 

5.8710824? - 1 -1.042887 7.226400F - 1 -4.944634F - 1 


H 0 = 2.816456 E - 2 

C 

1 

2 

1.7477444? — 1 1.517270F - 8 5.741567F - 1 1.224608 

1.399382 1.2148464? — 7 5.741567F - 1 -1.224608 


Ho = 8.9125094? - 1 

D 

1 

2 

9.208915 1.5618014? + 1 5.087094F - 1 -1.291110 

2.300089 1.721670 8.092186F - 1 -1.069291 


Ho = 6.6690864? - 4 


Show that the equation 

y(nT) = x(nT) + 2x(nT- T) + 3x(nT — 2T) + 4x(nT — 3T) + 3x(nT- 4T) 

+ 2x(nT- 5T) + x(nT- 6 T) 
represents a constant-delay system. 

Derive expressions for the amplitude and phase responses of the system shown in Fig. 5.4. 

Table P5.35 gives the transfer function coefficients of four digital filters labeled A to D. Using MATLAB, 
compute and plot 20 log M(co) versus a> in the range 0 to 5.0 rad/s. On the basis of the plots obtained, 
identify a lowpass, a highpass, bandpass, and a bandstop filter. Each filter has a transfer function of the form 

2 , 

... , .. TT a 0i + a li Z + flOi Z 

H(z) = H 0 II ———- — r 

boi+buz + z 2 

and the sampling frequency is 10 rad/s in each case. 

Table P5.35 Transfer-function coefficients for Prob. 5.35 


5.36. Show that the gain and phase shift in a digital filter satisfy the relations 

M(co s — (o) = M(a>) and 9(a> s — co) = — 6(a >) 
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CHAPTER 

6 


THE SAMPLING 
PROCESS 


6.1 INTRODUCTION 

The sampling process was briefly reviewed in Chap. 1 and there was reason to refer to it in Sec. 3.9.3. 
In this chapter, it is treated in some detail both from a theoretical as well as practical point of view. 
The sampling process involves several aspects that need to be addressed in detail, as follows: 

• The constituent components of a sampling system 

• The underlying principles that make the sampling process possible 

• The applications of the sampling process 

• The imperfections introduced through the use of practical components 

The sampling process requires several components. Converting a continuous- to a discrete¬ 
time signal would require some sort of a switch. However, a sampling system that uses just a simple 
switch would introduce a certain kind of signal distortion known as aliasing if the signal is not 
bandlimited. Continuous-time signals, man-made or otherwise, are only approximately bandlimited, 
at best, and almost always they must be preprocessed by suitable analog lowpass filters to render 
them bandlimited so as to prevent aliasing. At some point, a discrete-time signal would need to 
be converted back to a continuous-time signal and this conversion requires some sort of a sample- 
and-hold device. In practice, devices of this type tend to produce a noisy version of the required 
continuous-time signal and once again a suitable analog lowpass filter would be required to remove 
the noise introduced. 
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The one mathematical principle that makes the sampling process workable is the sampling 
theorem. The validity of this theorem can be demonstrated by examining the relationships that 
exist between the spectrums of continuous- and discrete-time signals. A most important relation in 
this respect is the so-called Poisson’s summation formula which gives the frequency spectrum of a 
discrete-time signal in terms of the spectrum of the underlying continuous-time signal. 

The connection between the spectral properties of discrete- and continuous-time signals is 
made by examining a class of signals referred to here as impulse-modulated signals. These are 
both sampled as well as continuous in time and, therefore, they share common characteristics 
with discrete-time signals on the one hand and continuous-time signals on the other. Consequently, 
they serve as a bridge between the discrete- and continuous-time worlds. The dual personality of 
impulse-modulated signals allows them to possess both a Fourier and a z transform and by exam¬ 
ining the properties of these signals, some fundamental relations can be established between these 
transforms. From this link follow the spectral relationships between discrete- and continuous-time 
signals. 

The study of impulse-modulated signals requires a clear understanding of what are impulse 
functions and what are their spectral characteristics. This subject has received considerable attention 
throughout most of the twentieth century and some very rigorous theories have been proposed, for 
example, the treatment of impulse functions as generalized functions [1], What these theories offer in 
rigor, they lack in practicality and, in consequence, they have not received the attention they deserve. 
At the other extreme, authors often define impulse functions in terms of thin tall pulses which are 
easy to reproduce in the lab but which lack the mathematical sophistication of generalized functions. 
In order to obtain a true impulse function, the duration of the pulse must be made infinitesimally 
small and its amplitude must be made infinitely large but this limiting operation is fraught with perils 
and pitfalls. In this chapter, a somewhat new way of looking at impulse functions is proposed which 
provides practical solutions to the classical DSP problems without compromising mathematical 
principles. 

Through the sampling process, digital filters can be used to process continuous-time signals. 
The continuous-time signal is first converted to a discrete-time signal, which is then processed by a 
digital filter. Subsequently, the processed discrete-time signal is converted back to a continuous-time 
signal. Once we establish a relation between analog and digital filters, in addition to our being able to 
use digital filters to perform analog-filter functions we can also design digital filters by using analog 
filter methodologies. In fact, some of the better infinite-duration impulse response (HR) digital filters 
are designed by transforming analog into digital filters. 

In addition to analog filters, switches, and sample-and-hold devices, a sampling system also 
uses quantizers and encoders. All these components have imperfections that need to be examined 
carefully. 

In this chapter, the Fourier transform theory of Chap. 2 is first extended to impulse functions 
and then to periodic and impulse-modulated signals. On the basis of these principles, Poisson’s sum¬ 
mation formula is derived in a rather practical way. From this formula, the crucial interrelations that 
exist between the spectrums of continuous- and discrete-time signals are established. From these 
interrelations, the conditions that must be satisfied for a discrete-time signal to be a true representa¬ 
tion of the underlying continuous-time signal become immediately obvious and the validity of the 
sampling theorem can be easily established. The chapter concludes by examining the imperfections 
introduced by the various components of the sampling system. 
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6.2 FOURIER TRANSFORM REVISITED 


6.2.1 Impulse Functions 

The properties and theorems of the Fourier transform described in Sec. 2.3.3 apply to the extent that 
the convergence theorem (Theorem 2.5) is satisfied. In practice, a number of important signals are 
not absolutely integrable and, therefore, two situations can arise: Either the integral in Eq. (2.27) or 
that in Eq. (2.29) does not converge. Signals of this category include impulse signals and the entire 
class of periodic signals. We will show in this section that many of the mathematical difficulties 
associated with these signals can be circumvented by paying particular attention to the definition of 
impulse functions. 

Impulse signals are used in many applications and are part and parcel of the sampling process, 
as will be demonstrated later on in this chapter; consequently, their properties, spectral or otherwise, 
must be clearly understood by the DSP practitioner. Such signals can be modeled in terms of impulse 
functions. A unit impulse function that has been used for many years can be generated by scaling the 
amplitude of the pulse signal in Example 2.5a from unity to 1/r, that is. 


Pt(t) = 


1 

~Pr(t) 

T 


£ for \t\ < tr /2 

0 otherwise 


The Fourier transform of this pulse is obtained from Example 2.5 a as 


TpAt) 


-FPr(t) 

X 


2sin&;r/2 

cor 


( 6 . 1 ) 


( 6 . 2 ) 


Evidently, as r approaches zero, the pulse in Eq. (6.1) becomes very thin and very tall, as can be 
seen in Fig. 6.1a but the area of the pulse remains constant and equal to unity. As long as r is finite, 
the absolute integrability of the signal is assured and, therefore, it would satisfy Theorem 2.5. If we 
now attempt to find the Fourier transform of the pulse as r —> 0, we get 


T lim p T (t) 

T —>-0 


lim p T (t)e Jarf dt 

T—>-0 



lim p T (t)e dt 

T — >0 


If we now attempt to evaluate the limit \\m T ^o[p T (1)e-j‘ ot ], we find that it becomes unbounded at 
x — 0 and, therefore, the above integral cannot be evaluated. More formally, the integral does not 
exist in the Riemann sense of a definite integral (see pp. 217-221 of Kaplan [2]). However, since the 
definite integral of a real function of t would give the area bounded by the graph of the function and 
the t axis, we might be tempted to write 


T lim p T (t) 

T —>0 



lim p T (t)e dt 

T — >0 


fz/2 


-ril 


lim p z (t)dt — 1 
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(a) 



Figure 6.1 Impulse function: (a) Pulse function for three values of e, ( b ) corresponding Fourier transform. 


since e~' <nt —> 1 for — r/2 < t < r /2 with r -> 0 and the area of the pulse p r (t) is equal to unity 
and remains unity as r -> 0. Many authors have taken this approach in the past [3]. Interestingly, the 
Fourier transform obtained in the above analysis is consistent with the limit of the Fourier transform 
of the pulse given by Eq. (6.2), that is. 


lim TprU) — lint 

t —^ 0 r —>0 


2sina>r/2 


= 1 


tor 
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Now, if we attempt to find the inverse Fourier transform of 1, we run into certain mathematical 
difficulties. From Eq. (2.29), we have 


I 

F~ l l = — e Jcot da 

./—/v-) 


1 

2:r 


cos cot dm + j / sin cot dm 


Mathematicians will tell us that these integrals do not converge or do not exist 1 and, therefore, we 
conclude that the inverse Fourier transform of 1 does not satisfy Eq. (2.29). 

Defining a unit impulse function in terms of an infinitesimally thin, infinitely tall pulse is 
obviously problematic. However, there are certain important practical advantages as well in using a 
thin, tall pulse. Specifically, pulses are very easy to create in terms of electrical voltage or current 
waveforms and, in fact, we will use them later on in this chapter in the implementation of sampling 
systems. For this reason, we would like to define the unit impulse function in terms of a thin, tall 
pulse but at the same time we would like to find a way to avoid the above mathematical pitfalls. 

The above difficulties can be circumvented in a practical way by defining impulse functions 
in terms of the way they interact with other functions under integration while adopting a somewhat 
practical interpretation of the limit of a function. In this approach, a function y(t ) is said to be a unit 
impulse function if for a function x(t) which is continuous for \t\ < e, we have 


y{t)x(t)dt — MO) 


(6.3) 


where the symbol — is used to indicate that the relation is approximate in the very special sense that 
the integral at the left-hand side can be made to approach the value of MO) to any desired degree of 
precision. Now consider the pulse function 


p e (t) = lim p r (t) = 


for \t\ < e/2 
otherwise 


with e 0 


where e is a small but finite constant. If we let 


Y(t) = p e (t ) 


(6.4) 


then Eqs. (6.3) and (6.4) yield 


lim p T (t)x(t)dt 



1 

- x(t ) dt 
e 


i r e/2 

-.r(O) / dt 
e J-e/2 


MO) 


1 Presumably the values of these integrals would depend on the limiting behavior of the sine and cosine functions at 
infinity but nobody seems to have come up with a reasonable answer for that so far! 
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and by making e smaller and smaller the integral at the left-hand can be made to approach the value 
;t(0) as closely as desired. In other words, the pulse function of Eq. (6.4) satisfies Eq. (6.3) and it is, 
therefore, an impulse function that can be represented, say, by S(t). 

From Eq. (6.4) and Table 2.1, we have 


2 sin wr /2 
lim p T (t) lim- 

T-s-e T-s-e (OX 


(6.5) 


As r is reduced, the pulse at the left-hand side tends to become thinner and taller whereas the so- 
called sine function at the right-hand side tends to be flattened out as depicted in Fig. 6.1 b. For some 
small value of c, the sine function will be equal to unity to within an error <S Woo over a bandwidth 
—cOoo/2 < o> < Woo/2 as shown in Fig. 6.1 b where a>oc is inversely related to 6, i.e., the smaller the 
e the larger the Woo- Evidently, for some sufficiently small but finite e, the sine function would be 
approximately equal to unity over the frequency range —Woo/2 to Woo/2 which could include all the 
frequencies of practical interest. Therefore, from Eq. (6.5), we can write 


8{t) = pft) 


2 sin&>e/2 

-= i(co) 

we 


( 6 . 6 ) 


and since 


2 sin we/2 

i(w) = -— ^ 1 


we 


for \co\ < Woo/2 


function i(w) may be referred to as a frequency-domain unity function. 
Let us now examine the sine function 


sincnrfr) = 


sin zut/2 


711 


This is, of course, a pulse-like function that tends to become thinner and taller as uj is increased, 
very much like the pulse in Fig. 6.1 a, as can be seen in Fig. 6.2a. Now let us consider the function 


sinc Woo / 2 (f) = lim 


sinnrt/2 sin®oot/4 


nr-xuco/2 7 Xt 


7Tt 


(6.7) 


where Woo is a large but finite constant. If we let 

y(f) = sine Moo/2 (0 

then Eqs. (6.3) and (6.7) yield 

sina.oot/4 

/ sine a> x / 2 (t)x(t) dt — / - x(t)dt 

7—00 7—00 ttt 


—OO ttt 

~ €/1 sin Woot /4 r /2 sinftJoof/4 

x{t)dt+ / --- x(t)dt 

J-f/2 


+ 


/e/2 


TXt 

sintt>oof/4 
TXt 


TXt 


x(t)dt 


(6.8a) 
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-20 -10 0 10 20 


(a) 


t 


1.5 


1.0 


0.5 


-6 -4 -2 0 2 4 ^6 

(b) 

Figure 6.2 Impulse function: (a) Sine function for three values of nr, ( b ) corresponding Fourier transforms. 
If 4>(x) is an absolutely integrable function and a and h are finite or infinite constants, then 

[ b 

lim / sin(<uf)</>(?) dt = 0 (6.8b) 

J a 





- ■ - m = \ 

- - - m=2 

- m=4 


i 

i 

i i 

i 

i i 

i 

1 

i 

1 1 

1 

1 1 

1 

■ 1 



.r ' 

i i 

' i 

i 

i i 

_1_:_ 

! ! 

i ' 

1 

i i 

i 

_!_!_ 



according to the Riemann-Lebesque lemma [4]. Thus if x(t)/t is absolutely integrable, the first and 
the last integrals at the right-hand side in Eq. (6.8a) approach zero. Since 


x(t) ^ x(0)|t| < e/2 


(6.8c) 
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Eqs. (6.8a)-(6.8c) give give 2 


r°° r ' 2 sinaW/4 

/ smc 0J ^ /2 (t)x(t)dt / - x(t)dt 

J— oo J—e! 2 ttt 


^ x(0) 


-e/2 77 1 

f €/2 sinwoof/4 
-e/2 


dt 


jrt 


Now for a large a > 00 , it is known that 

f €/2 sinaw/4 


/ —e/2 


7Tf 


sin Woof/4 
nt 


(6.8d) 


(6.8e) 


dt = 1 

(see pp. 280-281 of Ref. [4]) and, therefore, Eqs. (6.8d) and (6.8e) give 

no o 

/ sinc Woo/ 2 (t)x(t)dt - x(0) 


In effect, the sine function of Eq. (6.7) satisfies Eq. (6.3) and we conclude, therefore, that sinc Woo / 2 (r) 
is another impulse function that could be represented, say, by (fit). 

From Example 2.7, we have 


sin mt / 2 


7 rt 


where 


Pm(oj) — 


and hence from Eq. (6.9), we can write 


S'(t) = 


sin® 00 t/2 


nt 


p m (co) 


for \a>\ < uj /2 
otherwise 


Pco^iv) = i'(oj) 


(6.9) 


( 6 . 10 ) 


where 


i\a>) — 1 for \oo\ < a > 00 /2 

Like function /(&>), function i'ia>) behaves as a frequency-domain unity function as can be seen in 
Fig. 6.2 b. 

In the above analysis, we have identified two distinct impulse functions, namely, S(t) and <5'(r) 
and we have demonstrated that their Fourier transforms are unity functions, as shown in Table 6.1. 
In fact, there are other Fourier transform pairs with these properties but the above two are entirely 
sufficient for the purposes of this textbook. Since the two impulse functions have the same properties, 
they are alternative but equivalent forms and each of the two transform pairs in Eqs. (6.6) and (6.10) 
can be represented by 


5(f) ** i(co) 


2 See 278281 of Ref. [4] for a relevant discussion. 
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Table 6.1 Impulse and unity functions 


m 

t'M 

pft) 

sintWoof/2 

7lt 

2 sin coe/2 

0)€ 

Paiooiu) 


or even by the symbolic notation 


«5(0<~>1 (6.11) 

where the wavy, two-way arrow signifies that the relation is approximate with the understanding 
that it can be made as exact as desired by making e in Eq. (6.6) small enough or u>oo in Eq. (6.7) 
large enough. Symbolic graphs for the impulse and unity functions are shown in Fig. 6.3 a. 

Some important properties of impulse functions, which will be found very useful in establish¬ 
ing the relationships between continuous- and discrete-time signals, can be stated in terms of the 
following theorem: 

Theorem 6.1 A Properties of Time-Domain Impulse Functions Assuming that x (t) is a 
continuous function oft for \t \ <£, the following relations hold: 

/ •oo poo 

6{t — T)x(t)dt = / 6(—t + r)x(t)dt — x(t) 

-OO J — OO 

(b) 6(t — r)x(t) — 6{—t + T)x(t) — 6(t — r)x(r) 

(c) S(t)x(t) — S(—t)x(t) — S(t)x( 0) 


m 

K<o) 

1 


1 



t (O 


(a) 


i(t) 


Mo>) 


2tt 


CO 


(b) 


Figure 6.3 Fourier transforms of impulse and unity function: (a) S(t) -o- i(a>), ( b ) i(l) -o- 2nS(co). 
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Proof 

(a) From Eq. (6.6), we can write 


8(t — x)x(t)dt — / p € {t — r)x(t)dt 


1 pT+e/2 

— -x(r) / dt — xix) A 

t J z—ej'l 


(b) Let x(t) and f (f) be continuous functions of t for \t\ < e. We can write 


8(t — x)x{t)% (f)dt = / p € (t — r)x(t)^(t) dt 

) J — OO 

j rr+el 2 

— -.r(r)£(r) / dt 
€ J T—e/2 


On the other hand, 


- x(t)%(t) 


8(t — r)x(r)^(t)dt = / p e (t — z)x(r)^(t) dt 


- -*(t)£(t) 
e 


fT+e/2 




r—e/2 


— x(r)$(r) 

From Eqs. (6.13a) and (6.13b), we have 

/ OO poo 

S(t — z)x(t)$(t)dt — / S(t — r)x(r )$(t) dt 

-OO J — OO 

and, therefore, 


<5(r — r )x(t) — 8(t — t)x(r) 

Since impulse functions, as defined above, are even functions of t , we have 
8(—t) = S(t ) and 8(—t + r) — 8(t — r) 
and hence Eqs. (6.14a) and (6.14b) yield 

8(t — x )x(t) — 8(—t + x)x(t) — 8{t — t)jc(t) A 

(c) Part (c) follows readily from part ( b ) by letting r = 0. A 


(6.13a) 


(6.13b) 


(6.14a) 


(6.14b) 
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In words, part (a) of the theorem is saying that integrating an impulse function times a contin¬ 
uous function causes the integral to assume the value of the continuous function at the location of 
the impulse function. Similarly, parts (b) and (c) are saying that multiplying a continuous function 
by an impulse function yields a product of the impulse function times the value of the continuous 
function at the location of the impulse. 

The above theorem applies also to the impulse function in Eq. (6.10). The theorem is essentially 
a generalization of the definition of impulse functions and, in fact, any distinct functions that satisfy 
it may be deemed to be equivalent impulse functions. The theorem is of considerable practical 
importance as will be found out later on in this chapter. 

In the above analysis, time-domain impulse functions have been examined whose Fourier 
transforms are unity functions in the frequency domain. Occasionally, frequency-domain impulse 
functions are required whose inverse Fourier transforms are unity functions in the time domain. Such 
functions can be readily obtained from the impulse and unity functions examined already and, as 
will be shown below, they are required for the spectral representation of periodic signals. Consider 
the Fourier transform pair in Eq. (6.6), namely, 

2 sin a>e /2 

<$(0 = Pe(t) - = l(m) 

coe 

By applying the symmetry theorem (Theorem 2.7), we can write 

i(t) -o- 2jtS(—a>) (6.15a) 


where 


2 sinfe/2 

m = -— ^ i 

te 


for \t\ < ^ 


(6.15b) 


and 


S(— a>) = lim p m (—cn) = lim p m (co) = 8(a >) (6.15c) 

7U—>€ UT—>€ 

where too is a positive constant that defines the range of t over which i(t) — 1 and is inversely related 
to e. Therefore, from Eqs. (6.15a)-(6.15c), we can write 

i(t) ** 2jt8(co) (6.16a) 


or 


1 2n8(w) (6.16b) 

where i(t) and 8(aj) may be referred to as time-domain unity function and frequency-domain unit 
impulse function , respectively, by analogy with the frequency-domain unity function and time- 
domain impulse function, respectively. These functions can be represented by the symbolic graphs 
of Fig. 6.3 b. 

The properties of time-domain impulse functions apply equally well to frequency-domain 
impulse functions as summarized by Theorem 6. IB below. 
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Theorem 6.1B Properties of Frequency-Domain Impulse Functions Assuming that X{j uj) 
is a continuous function of uj for |cu| < e, the following relations hold: 

/ OO POO 

6(uj — Tzr)X(J u>) du) — / 6(—u) + zv)X(fu>)duj — X(jzu) 

-oo J — OO 

(b) 6(u> — zu)X(ju:) — 6 (—uj + zu)X(ju:) — 6 (uj — zu)X(j'cv) 

(c) 6(u)X(jw) = 6(-w)X(jw) - <5MX(0) A 


6.2.2 Periodic Signals 

The above approach circumvents the problem of impulse functions in a practical way. However, a 
similar problem arises if we attempt to find the Fourier transform of a periodic signal. Consider, for 
example, x(t ) = cosmo t. We can write 


Tx(t) = 


/ OO POO 

(cos coot )e~^ cot dt = / \ [i 

-oo J —OO 

/ oo 

\ [e j(co + e-tt 0 *-* 0 *] dt 

-oo 

/ oo 

' {cos [(&) 0 — &>)r] + j sin[((Uo — a>)f] 

-oo 

+ cos[(&>o + o))t] — j sin[((Wo + co)t]} dt 


+ e -j<oon e -j<ot dt 


As can be seen, we have run into the same difficulty as before, that is, we are attempting to evaluate 
integrals of sines and cosines over the infinite range —oo < t < oo and, therefore, Tx(t) does not 
exist. However, this problem can also be circumvented in a practical way by simply using the 
transform pair in Eq. (6.16a). On applying the frequency shifting theorem (Theorem 2.10), we can 
write 


i(t)e jo>ot ** 2nS(co — coq) 


and 


i(t)e j ‘° 0 ' ** 2tx8(co + coq) 


and since i (t) — 1, we have 


e j±a)ot 2jt8(co co 0 ) 

If we add Eqs. (6.18a) and (6.18b), we deduce 

i(t)[e lm,t + e-^ 01 ] ** 2:x[8(co - coq) + 8(co + tt> 0 )] 


(6.18a) 


(6.18b) 


(6.18c) 
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Figure 6.4 Fourier transform of cosine function: x(t ) -o- X(jco) where x(t) = cos coot and X(ja >) = 

jr[<5(w — wo) + 8(co — wq)]. 


and hence 


i(t) cos coot 4* jr[<5(<y + coq) + S(co — co o)] 

Since i(t) — 1 for \t\ < too (see Eq. (6.15b)), we may write 

cos coot 7r[(5(c(j + coq) + 8(w — ®o)] (6-19) 

The Fourier transform of a cosine function can thus be represented by the symbolic graph of Fig. 6.4. 
If we now subtract Eq. (6.18b) from Eq. (6.18a), we obtain 

i(t)[e j0, °' - e~ joi0 ‘] 4* 2it[S(co - co 0 ) - 8(co + £u 0 )] 


and hence 


i(t) sin&>of 4* jjt[8(co + co o) — 8(co — a>o)l 


or 


sin (Wo? jtt[8(co + coq) — 8(co — &>o)] (6.20) 

With Fourier transforms available for exponentials, sines, and cosines, Fourier transforms of 
arbitrary periodic signals that satisfy the Dirichlet conditions in Theorem 2.1 can be readily obtained. 
From Eq. (6.18a), we can write 


i(t)Xi c eJ k, ’ w 4* 2jTXk8(co — kcoo) 


( 6 . 21 ) 


OO OO 

i(t) ^ Xke jkmt 4 * 2n ^ Xk8(co — kcoo ) 

k— —oo k— —oo 


Therefore, Eq. (2.3) gives 
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or 


oo oo 

x(t) = Y X k e jkwot 2it Y x k S( ~ ca - kc °o) (6.22) 

k ——oo k=—oo 

In effect, the frequency spectrum obtained by applying the Fourier transform to a periodic signal 
comprises a sequence of frequency-domain impulses whose strengths are equal to 2n times the 
Fourier series coefficients {Xj.}. 


6.2.3 Unit-Step Function 

Another time function that poses difficulties is the unit step u(1) as can be easily shown. However, 
by defining the unit step in terms of a function that is absolutely integrable, the problem can be 
circumvented in the same way as before. We can define 


u{t) — lim 

a—>€ 



for t > 0 
for t < 0 


where e is a very small but finite constant. The Fourier transform for the unit step can be obtained 
from Example 2.6«, as 


1 

U ( ico) = lim- 

jco + a 


or 


u(t) — (6.23) 

ja> 

The Fourier transform pairs obtained in this chapter along with those obtained in Chap. 2 
are summarized in Table 6.2 for the sake of easy reference. For impulses and periodic signals, the 
transforms are approximate, as has been pointed out earlier, but can be made to approach any desired 
degree of precision by making e in Eq. (6.6) smaller and atoo in Eq. (6.10) or too in Eq. (6.1 5b ) larger. 
Note that the impulse functions in Eqs. (6.6) and (6.10) would break down if we were to make e zero 
in the first case and &><*, infinite in the second case but in practice there is very little to be gained in 
doing so. After all pulses of infinite amplitude cannot be created in the laboratory. 

6.2.4 Generalized Functions 

Analogous but exact Fourier transform pairs to those given by Eqs. (6.11), (6.16b), (6.18c), (6.19), 
(6.22), and (6.23) can be obtained but a more sophisticated definition of impulse functions is required 
in terms of generalized functions 3, as detailed by Lighthill [1], In that approach, impulse and unity 
functions are defined in terms of well-behaved functions that can be differentiated any number of 


3 See Ref. [5] for a brief introduction to generalized functions. 
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Table 6.2 Standard Fourier transforms 



times, for example, in terms of exponential functions such as *] (n/ tt)e~ nr and e~ r,,4 '\ respectively 
(see Example 2.11). It turns out that generalized functions solve one problem, namely, the limiting 
behavior of impulse functions, but create another: Apart from being of a somewhat abstract nature, 
generalized functions are also difficult, if not impossible, to realize in terms of voltage or current 
waveforms in the laboratory. In the practical definitions of impulse and unity functions defined in 
Sec. 6.2.1, the transform pairs are approximate but as parameter e in Eq. (6.6) is reduced and pa¬ 
rameter a>oo in Eq. (6.15c) is increased, the inexact transform pairs tend to approach their exact 
counterparts. In effect, the approximate transform pairs are for all practical purposes equivalent to 
their exact counterparts. In subsequent sections of this chapter and later on in the book the special 
symbols and — will sometimes be replaced by the standard two-way arrow and equal to sign. 
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respectively, for the sake of consistency with the literature but with the clear understanding that an 
approximation is involved as to what constitutes an impulse function. 


Example 6.1 


(a) Find the Fourier transform of the periodic signal 


x(t) — cos 4 a>ot 


( b ) Repeat part (a) for the periodic signal 

OO 

x(t) = x(t + nT) 

n=—oo 


where 


x(t) 


Mil Wot 

0 


for 0 < t < to/2 
for — tq/2 < t < 0 


where wo — 2 jt /xq. 


■ Solution 

(a) We can write 

x(t ) = (cos 2 wot)(cos 2 wot ) 

= i(cos2<wo t + l)(cos2®o? + 1) 

= i(cos 2 2wot + 2cos2®o ? + 1) 

= i [' (cos 4wot + 1) + 2 cos 2wq t + l] 

= g cos 4wq t + \ cos 2wot + | 

Now from Table 6.2, we get 

X(jw) = 7r|g[5(® + 4w 0 ) + S(w - 4®o)] + j[S(co + 2w 0 ) + S(w - 2w 0 )] + j<5(®)} ■ 

( b ) The Fourier series of periodic signal x{t) is given by Eqs. (2.3) and (2.5) where 

1 / >r »/ 2 

X n = — / [u(t) sin WQt]e~i n01at dt 

r 0 J-ro/2 
1 /to/2 

= — / sinwo f [cosn/uo f — j sin nojQt] dt 

to J o 

l /To/2 

= — / [cos nwot sin wot — j sin nwot sin wot\ dt 

to Jo 
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1 | T °/ 2 , . 

= — / < [sin(« + l)a>of — sin(« — l)a>of] — /[cos(n — l)(Dot + cos (n + Y)ooot} > 

2r 0 Jo 1 J 


1 

2 to 

1 

4n 

1 

47r 


■ cos(« + l)ct>of cos(n — 1)&>o t sin(n — \)wot sin(n + l)a>o f 

■ J-, -+- + j 


-|t„/2 


(n + l)<wo 


(n - 1 )two 


(n - l)«o 


(n + 1)&>o Jo 


cos(n — 1 )tt — 1 cos(t? + 1 )tt — 1 . sin(n — 1 )tt . sin(n + l)jr 


77—1 « + 1 

— cos mx — 1 — cos 77 7T — 1 


- J- 


n — 1 


+ j- 


n + 1 


sinnjr sm«7T 

+ j -r - J 


ii — 1 


77+1 


77 — 1 77+1 

COS 77 7T + 1 — j sin717T 
2rc{n 2 — 1) 


Evaluating X n and noting that l’Hopital’s rule is required for the cases n = ±1, the 
following values of X n can be obtained: 

*o = - X x = -X^ = - J - X 2 = X. 2 = -^~ 
i r 4 37r 


X 3 = X_ 3 = 0 Z 4 = X_ 4 


1 

157T 


*5 = Z_5 = 0 


*6 = X_ 6 = 


35j r’ 


On using Eqs. (2.9) and (2.10), the Fourier series of x(t) can be deduced as 

OO OO 

x(t) = \a 0 + E a n cos ncoQt + b n sin ncoot (6.24) 


n= 1 


n= I 


where 


«o = 2 Xq 


b n = j(X n - X_ n ) 


ao = 


2 2 

a i = 0 a 2 = -a 3 = 0 04 = - 

37T 157T 


a 5 = 0 a 6 = 


35tt 


a 2 = 0, 


b x = — b 2 — 0 b 2 — 0 b4 = 0 i>5 = 0 £>6 = 0, 


dt 
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Now from Table 6.2, we get 


oo 


J-x(t) = aoTt8(co) + a n n[8(a) + ncoo) + 8(co — ncoo)] 
k=i 


oo 


+ jb„jr[S( (o + ncoo) ~ S(co — ncoo)] ■ 
k =1 


(6.25) 


6.3 INTERRELATION BETWEEN THE FOURIER SERIES 


AND THE FOURIER TRANSFORM 

Discrete-time signals are usually sampled versions of continuous-time signals and, therefore, it stands 
to reason that they inherit their spectral characteristics from the continuous-time signals from which 
they are derived. Specifically, if the frequency spectrum of the underlying continuous-time signal is 
known, then that of the discrete-time signal can be deduced by using Poisson’s summation formula. 
The following theorem is prerequisite for the derivation of this most important formula. 


Theorem 6.2 Fourier-Series Kernel Theorem 


OO 


OO 



(6.26) 


where us s = 27 t/T. 

The relation in Eq. (6.26) can be demonstrated to be valid on the basis of the principles 
developed in Sec. 6.2. To start with, on applying the inverse Fourier transform to the right-hand side 
of Eq. (6.26 ), we get 



OO 


OO 



and from Theorem 6.IB, part (a), we have 



(6.27) 


Consider the so-called Fourier-series kernel (see Papoulis [4], pp. 42-45), which is defined as 



n=-N c 


(6.28) 
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where is a finite integer. Since this is a geometric series with common ratio e JOh ', its sum can be 
obtained as 



,j?uo s t _ 


T - 1 


1 e ./Wxj+l)<V _ e -jNooa> s t 


j gj(2Noo+l)(D s t/2 _ g—j(2Noo+l)(D s t/2 


T e jn> s t/2 _ e -ju> s t/2 

1 sin[(2A^ 00 + \)co s t/2\ 

T sin(cu,f/2) 


(see Eq. (A.46b)). We can write 



sin[(2Aoo + l)<Wjf/2] 


nt 


and if we let (2Noo + 1 )a> s = O)oo, then 



sin«oot/2 


7 Tt 


If Noo 1, (sill (O.oct/2)/rct behaves as a time-domain impulse function (see Table 6.1) and hence 
for —T/2<t<T/2, can be expressed as 


k N jt) = mm 


where function 


T sin(o> J t/2) 

is continuous and assumes the value of unity at t = 0. Now from Theorem 6.1 A, part (c), we get 

k N jt) = mm ^ mm = m 

At this point, if we let t = t + nT in k Nr j t) , we can easily verify that the Fourier-series kernel is 
periodic with period T, as illustrated in Fig. 6.5 (see Prob. 6.14, part (a)). Therefore, for N 00 1, 

it behaves as an infinite series of impulse functions located at t — 0, ±7\ ±27, ..., ±«7,... and 
from Eq. (6.28), we can write 



n=—N c 


n=—oo 


(6.29) 
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Figure 6.5 Fourier-series kernel. 

Since Noo 1, Eqs. (6.27)-(6.29) yield 


T~ x 


COs 


8(a> — na> s ) 


n =—oo 


l 


T 


OO 

e jnco,t 

n=—oo 


-t ly OO 

_ ST' e jna) s t 
J' / 
n=-Noo 


oo 

- nT] 
11 ——oo 


Impulse functions as defined in Sec. 6.2.1 are absolutely integrable and hence they satisfy the 
convergence theorem of the Fourier transform (Theorem 2.5). We thus conclude that 

OO OO 

8(t — nT) <~w co s 8(a> — nco s ) A 

ii ——oo n=—o o 


An exact version of the above result can be obtained through the use of generalized functions 

[5]. 

The Fourier-series kernel theorem (Theorem 6.2) leads to a direct relationship between the 
Fourier series and the Fourier transform. This relationship is stated in the following theorem: 


Theorem 6.3 Interrelation Between the Fourier Series and the Fourier Transform Given 
a tionperiodic signal x(t) with a Fourier transform X(ju>), a periodic signal with period T 
can be constructed as 


OO 

x(t) = ^ x(t + nT) 


n=—o o 


(6.30) 
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Figure 6.6 Generation of periodic signal x(t) through the addition of an infinite number of shifted copies of 
x(t) over the range —oo < t < oo. 


(see Fig. 6.6 and Prob. 6.14, part (b)). The Fourier series coefficients ofx(t ) are given by 


X n 


X{jnu> s ) 

T 


(6.31) 


where 


X(juj) = Tx (t) 

The above theorem states, in effect, that the Fourier series coefficient of the nth harmonic of 
periodic signal x(t) is numerically equal to the Fourier transform ofx(t) evaluated at the frequency 
of the harmonic divided by T. 

The validity of the relationship in Eq. (6.31) can be demonstrated by using our practical 
approach to impulse and unity functions as described in Sec. 6.2.1. From Eq. (6.22), the Fourier 
transform of a periodic signal x(t ) is given by 


OO 

X(ja>) — 2jT X n S(co — nco s ) 


n=—o o 


(6.32) 
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From Theorem 6.1 A, part ( a ), Eq. (6.30) can be expressed as 

oo 

x{t) = x(t + nT) 

11 —— OO 

°° poo 

— / x(r)S(t — r + nT)dr 

/ oo 00 

x(r) S(t — r + nT)dr 

00 n=-oo 

OO 

— x(f) <g> ^ 8(t — nT) 


(6.33) 


where the last two lines represent time convolution (see Theorem 2.14), and on using Theorem 6.2 
and Eq. (6.33), we obtain 

OO 

X(jco) — J-x(t) ■ T 8{t — nT ) 

n=— oo 
oo 

— X(jco)-co s 8(co — na> s ) 

11 ——OO 

^ X(ju) 

— 27t - 8(a> — nco s ) (6.34) 

11 — — OO 

If we now use Theorem 6. IB, part ( b ), Eq. (6.34) yields 

X(jnco s ) 

X{jco)^2n T S(co-nco s ) (6.35) 

« = —OO 

and on comparing Eqs. (6.32) and (6.35), we deduce 

^ X(jna> s ) 

Xn y, “ 

It should be mentioned at this point that Eq. (6.31) holds independently of the values of x(t) 
for |t| > T /2. If x(t) = 0 for |f | > T /2, the shifted copies of x(t) do not overlap and 

x(t) — x(t) for \t\ <T/2 

whereas if x(t) ^ 0 for |f| > T/ 2, they do overlap and so 


x(t) ^ x(t) for \t\ < T/2 
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In the latter case, x(t) is said to be an aliased version of x(t). For the nonaliased case, the Fourier 
series coefficients give one spectral representation for a periodic signal and the Fourier transform 
gives another, which are interrelated through Eq. (6.31). 


Example 6.2 


Given the nonperiodic signal 


x(t) = p T /2 (t+ \t) - p x/2 {t -\t) 

where 

J 1 for |/| < r/4 

^ T// " 10 otherwise 

a periodic signal x(t) with period T such as that in Eq. (6.30) can be constructed. Show that 
the Fourier series coefficients of x(t) are related to the Fourier transform of x(t) through the 
relation in Eq. (6.31). 


■ Solution 

The Fourier series coefficients of x(t) can be obtained from Example 2.3 as 


X 


n 



for n = 0 

for n = 1, 2, ... 


(6.36) 


by noting that k = n. to = T, and wq = a> s = 2 tx/ T in the present context. From the 
definition of the Fourier transform, we can write 


X(jco) = 



and since x(t) is an odd function of t, Eqs. (2.37a)-(2.37b) give 

X(jco) — d\e X(jco) + j 3m X(ja >) (6.37a) 


where 


me X(jco) = 0 


(6.37b) 
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and 


3mX(jco) = — 2 / x(t) sincot dt 

Jo 

rt/2 


= -2 


= 2 


cos tot 


- sin tot dt 

r/ 2 


to 


0 


= 2 


■ cos&>t/2 + 1 


nr/2 


CO 


4sin 2 a>r/4 

to 


Hence Eqs. (6.37a) and (6.37c) give 


. 4sin"ft)r/4 


X(jco) = j 

to 

where A(0) = 0 as can be readily verified. If we let to = nco s , we get 

( 0 for n — 0 

X(jnoo s ) = < 4 sin 2 nto s r/4 

j - for n = 1, 2, ... 


(6.37c) 


(6.38) 


Now on comparing Eqs. (6.36) and (6.38), we note that Theorem 6.3 is satisfied. 


6.4 POISSON’S SUMMATION FORMULA 

Given an arbitrary nonperiodic signal x(t ) that has a Fourier transform, the periodic signal in Eq. (6.30) 
can be immediately constructed. Such a signal has a Fourier series of the form 

OO OO 

x(t)= x{t + nT)= Y x ne jna>st (6.39) 

ft ——oo n=—oo 


Now from Eqs. (6.31) and (6.39), we obtain 

OO j OO 

Y x( J + nT ^=j Y x Unco s )e JO>s ‘ (6.40) 

n=—c o n=—oo 

This relationship is known as Poisson’s summation formula and as will be shown below, it provides 
a crucial link between the frequency spectrum of a discrete-time signal and that of the underlying 
continuous-time signal. 
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Two special cases of Poisson’s formula are of interest. If x(t ) assumes nonzero values for 
t < 0, then if we let t = 0 in Eq. (6.40), we obtain 


y x(nT) = — ^2 X{jna>s) 


(6.41a) 


On the other hand, if x(t ) = 0 for t < 0, then 

oo i OO 

lim*(0 + Y]x(nT)= — V X{jnco s ) 
r—>o z ' T L —' 


(6.41b) 


n =1 


Now the Fourier series also holds at a discontinuity provided that the value of the periodic signal at 
the discontinuity is deemed to be 


limx(?) 
■ ■ 


*( 0 -) + *( 0 +) 


(see Theorem 2.1) and since x(0— ) = 0 in the present case, Eq. (6.41b) assumes the form 

/ n , x OO i OO 

)-h ^xinT) = — jr X(jna> s ) 


n= 1 


x(nT) = 


x(0+) 1 


y. X(jna> s ) 


n= o 


(6.41c) 


where x(0) = x(0+). 

Poisson’s summation formula is illustrated in Fig. 6.7 for the signal 

x(t ) = u(t)e~ al sin cut 

with a = 0.35 and = 2.6. This important formula states, in effect, that the sum of the signal values 
of x(t) at t = nT in Fig. 6.7a over the range — oo < t < oo is equal to the sum of the complex 
values 

X(jnco s ) = \X(j■na>,)\e^ x ^ 

in Fig. 6.7b for — oo < n < oo divided by the sampling period T. 

As an aside, note that there is only one term in the time-domain summations in Eqs. (6.41a) 
and (6.41c) if x(t) — 0 for \t | > T /2, and hence we have 


f -oo 

*(0+) _J_ J_ V^OO 

T 


if x(t) — 0 for t < —T/2 and t > T /2 
+ 7 J2T=-oo x (j nco *) ^ x (0 = 0 for t < 0 and t > T /2 


x(0) = 
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Figure 6.7 Poisson summation formula for the case where x(t) is defined over the range — oo < t < oo: 
(a) Time domain, (b) frequency domain. 


6.5 IMPULSE-MODULATED SIGNALS 

An impulse-modulated signal , denoted as x(t), can be generated by sampling a continuous-time signal 
x(t) using an impulse modulator as illustrated in Fig. 6.8 a. An impulse modulator is essentially a 
subsystem whose response to an input x(t) is given by 

x(t) — c(t)x(t) (6.42a) 


where c(t) is a carrier signal of the form 

OO 

c(t)= <5(7 — nT) 


n =—oo 


(6.42b) 
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M) 


0 ) 


Figure 6.8 Generation of an impulse-modulated signal: (a) Ideal impulse modulator, ( b ) continuous-time 
signal, (c) impulse-modulated carrier, ( d ) impulse-modulated signal x(t), ( d ) discrete-time signal x(nT). 


(see Fig. 6.8c). From Eqs. (6.42a) and (6.42b), we have 


oo 

x(t) = x(t) S(t — nT) 

n =—oo 
oo 

= x(t)S(t — nT) 


n=—o o 


(6.42c) 
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and if we apply Theorem 6.1 A, part (/?), to Eq. (6.42c), we obtain 


oo 


*(*) = E x(nT)8(t — nT) 


(6.42d) 


Often x{t) = 0 for t < 0—. In such a case Eq. (6.42d) assumes the form 


OO 


m = E x(nT)8(t — nT) 


(6.42e) 


n= 0 


In effect, an impulse-modulated signal is a sequence of continuous-time impulses, like that 
illustrated in Fig. 6.8 cl. A signal of this type can be converted into a discrete-time signal by simply 
replacing each impulse of strength x{nT ) by a number x(nT) as shown in Fig. 6.8e. 

6.5.1 Interrelation Between Fourier and z Transforms 

Observe that an impulse-modulated signal is both a sampled as well as a continuous-time signal and 
this dual personality will immediately prove very useful. To start with, since it is continuous in time, 
it has a Fourier transform, that is. 


OO OO 


X(ja >) = T y x(nT)8(t — nT) = x{nT)T8{t — nT) 


(6.43a) 



Clearly 


OO 



(6.43b) 


where 


X D (z) = Zx(nT) 


For a right-sided signal, Eq. (6.43b) assumes the form 


OO 



(6.43c) 


The above analysis has shown that the Fourier transform of an impulse-modulated signal x(t) 
is numerically equal to the z transform of the corresponding discrete-time signal x(nT) evaluated 
on the unit circle |z| = 1. In other words, the frequency spectrum of x(t) is equal to that of x(nT). 
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Example 6.3 


(a) The continuous-time signal 


x(t) = < 


0 

1 

2 

1 

0 


for t < 3.5 s 
for —3.5 < t < —2.5 
for —2.5 < t < 2.5 
for 2.5 < t < 3.5 
for t > 3.5 


is subjected to impulse modulation. Find the frequency spectrum of x(t) in closed form as¬ 
suming a sampling frequency of lit rad/s. (/;) Repeat part (a) for the signal 


x(t) = u(t)e ' sin2r 


assuming a sampling frequency of 2n rad/s. 


■ Solution 

( a) The frequency spectrum of an impulse-modulated signal, x(t), can be readily obtained 
by evaluating the z transform of x(nT) on the unit circle of the z plane. The impulse- 
modulated version of x(t) can be expressed as 

x (t) = S(t + 3 T) + 2 S(t + 2 T) + 2 S(t + T) + 28(0 ) 

+2 S(t -T) + 28(t - 2 T) + 8(t - 3 T) 

where T = 1 s. A corresponding discrete-time signal can be obtained by replacing 
impulses by numbers as 

x(nT) = 8(nT + 37) + 28(nT + 27) + 28(nT + 7) + 23(0) 

+2<$(«7 - 7) + 28(nT - 27) + 8(nT - 37) 

Hence 

X D (z) = Zx(t ) = z 3 + 2z 2 + 2z l + 2 + 2z -1 + 2z" 2 + z" 3 

and, therefore, from Eq. (6.43b) 

X(joj) = X D (e i0>T ) = ( e j3a,T + e ~ j3a,T ) + 2(e j2o,T + e ~ j2o,T ) 

+ 2(e jmT + e~ jloT ) + 2 
= 2 cos 3a>T + 4 cos 2coT + 4 cos coT + 2 ■ 
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( b ) A discrete-time signal can be readily derived from x(t) by replacing t by n T as 


x(nT) = u(nT)e " r sin2 nT = u(nT)e nT x — (e 22nT — e * 2nT ) 

2 j 


= M( „ r) J_( e «n-i+f2)_ e «7-(-W2)) 


Since 7 = 2jr /co s = 1 s. Table 3.2 gives 


Xd(Z) 2 ;( z - e - 1 +^ 2 z - e - W 2 


and after some manipulation 

X D (z) = 


ze 1 sin 2 


z 2 — 2ze _1 cos 2 + e~ 2 
Therefore, the frequency spectrum of the impulse-modulated signal is given by 

~ ■ r e ;<B_1 sin2 

X(Jo>) = X D (e ja>T ) = 


e 2 ja> _ 2ei u ’~ l cos 2 + e~ 


6.5.2 Spectral Interrelation Between Discrete- and 
Continuous-Time Signals 

Let X(ja>) be the Fourier transform of x(t). From the frequency-shifting theorem of the Fourier 
transform (Theorem 2.10), the transform pair 

x(t)e~ jl ° 0 ' o X(jcoo + jco) 

can be formed. On using Poisson’s summation formula given by Eq. (6.41a), we get 

1 


XX JmnT = 7 X! x U°>o + jnco s ) 


where co s = 2 it/T and if we now replace &>o by a>, we obtain 


XX x(nT)e jmlT = — XX X(jco + jnco s ) 


n =—oo 


n=—o o 


(6.44) 
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Therefore, from Eqs. (6.43b) and (6.44), we deduce 

X(jco) = X D (e ]ajT ) = — X (J W + i n( °s) 

n=—o o 


(6.45a) 


Similarly, for a right-sided signal, the use of Eq. (6.41c) in the above analysis along with Eq. (6.43c) 
gives 


, jc( 0+) 1 v- 

X(jco) = X D (e J " T ) = —- + - J2 

n=—o o 


(6.45b) 


that is, the frequency spectrum of the impulse-modulated signal x(t) is equal to the frequency spectrum 
of discrete-time signal x(nT) and the two can be uniquely determined from the frequency spectrum 
of the continuous-time signal x{t), namely, X(jco). 

As is to be expected, X(ja> ) is a periodic function of a> with period co s since the frequency 
spectrum of discrete-time signals is periodic as shown in Sec. 3.9.2. Indeed, if we replace ja> by 
jto + jmco s in Eq. (6.45a), we get 


j 

X(jco + jmco s ) = — ^2 X [J W + j(m + n)co s ] 

n=—o o 
| oo 

= y + J n ' w ^ 

n'=—oo 

= X(ja>) 


The above relationships can be extended to the s domain. By virtue of a principle of complex 
analysis known as analytic continuation (see Sec. A.8), given a Fourier transform F{jco), the Laplace 
transform F{s) can be obtained by replacing ja> by s in F(jco), that is. 


F(s) = F(jco) 


]U>=S 


(See Sec. 10.2.2 for a more detailed description of the Laplace transform.) Thus if we let jw — s 
and e sT = z, Eqs. (6.45a) and (6.45b) assume the forms 

j 

A(.v) = X D (z) = — ^2 X(s + jncos) 

11— — OO 


(6.46a) 
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and 



(6.46b) 


where X(s) and X(s) are the Laplace transforms of x(t) and x(t), respectively. If the value of a (0+) 
is not available, it can be deduced from X(s ) as 


x(0+) = lim [il(s)| 


by using the initial-value theorem of the one-sided Laplace transform [3] (see Sec. 10.2.4). 

The relationship in Eq. (6.46b) turns out to be of significant practical importance. It will be 
used in Sec. 6.9 to establish a relationship between analog and digital filters. This relationship is the 
basis of the so-called invariant impulse-response method for the design of HR filters described in 
Chap. 11. 



(a) Using Poisson’s summation formula, obtain X(jco) if x(t) = coscoot. 


( b ) Repeat part (a) for x(t ) = u{t)e '. 

■ Solution 

(a) From Table 6.2 

X(j(L>) = T coscoot = 7r[<5(&> + &>o) + S(® — &>o)] 
Hence Eq. (6.45a) gives 


OO 



n=—oo 


The amplitude spectrum of x(t) is illustrated in Fig. 6.9 a. 
(. b ) From Table 6.2, we have 


X(jat) = T[u(t)e-‘] = —— 

1 + JO) 


Since 


jc( 0+) = lim[n(f)e" f ] = 1 
t-* o 
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|x(»| 


-2o) s -a> s -ru 0 a> 0 a> s 2 u> s 

(a) 




Eq. (6.45b) gives 

1 1 ^ 1 

X(jv) = - + - 2 ^ | . ■, , - 7 ■ 

2 T z —' 1 + j((o + na) s ) 

n=—o o 

The amplitude spectrum of x(t) is plotted in Fig. 6.9 b for a sampling frequency co s = 
15 rad/s. 
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6.6 THE SAMPLING THEOREM 

The application of digital filters for the processing of continuous-time signals is made possible by 
the sampling theorem 4 which is as follows: 

Theorem 6.4 Sampling Theorem A bandlimited signal x(t ) for which 

X(ju) = 0 for M > y (6.47) 

where tv s — lit / T, can be uniquely determined from its values x(nT). ▲ 

The validity of the sampling theorem can be demonstrated by showing that a bandlimited 
signal x(t) can be recovered from an impulse-modulated version of the signal, x(t ), by using an ideal 
lowpass filter as depicted in Fig. 6.10. * * * * 5 

Assume that x(t ) is bandlimited and that the sampling frequency a> s is high enough to ensure 
that the condition in Eq. (6.47) is satisfied. The frequency spectrum of such a signal could assume 
the form depicted in Fig. 6.11a. Poisson’s summation formula in Eq. (6.45a) gives the frequency 
spectrum of the impulse modulated signal x(t) as 

1 OO 

= — ^2 x Uu + jncof) 

n=—oo 

Evidently, the spectrum of x(t ) can be derived from that of x(t) through a process of periodic 
continuation whereby exact copies of the spectrum of x(t)/T are shifted by frequencies {• • •, —2a> s , 
—w s , co s , 2co s , • • ■} and are then added. If x(t) satisfies the condition in Eq. (6.47), then the shifted 
copies of the spectrum, often referred to as sidebands, would not overlap and, consequently, the 
spectrum of x(t) would assume the form depicted in Fig. 6.11/?. If the impulse-modulated signal 
is now passed through an ideal lowpass filter with cutoff frequencies at ±<u s /2 as illustrated in 
Fig. 6.11c, all the sidebands would be rejected and the spectrum of the filter output would be an 



Figure 6.10 Sampling theorem: Derivation of x{t) from x(t) by using a lowpass filter. 


*The sampling theorem is attributed to Nyquist, Shannon, or both, depending on what one reads. In actual fact, the 

historical record shows that both of these individuals made a significant contribution to the sampling theorem. Nyquist 

provided an intuitive derivation of the sampling theorem as early as 1928 in Ref. [6] whereas Shannon provided a rigorous 

proof for it in Ref. [7], 

5 See Sec. 10.2 for a brief summary of the basics of analog filters. 
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(a) 



C b ) 


X 

H(jco) 





^ T 


C0 S (O s O) 

T T 

(c) 



(d) 


Figure 6.11 Sampling theorem—derivation of x(t) from x(t) by using a lowpass filter: (a) X(ja>), 

(b) X(jco), (c) frequency response of ideal lowpass filter, (d) lowpass-filtered version of X(ja>). 

exact copy of the spectrum of the continuous-time signal, that is, the continuous-time signal will be 
recovered, as shown in Fig. 6.1 Id. 

The above thought experiment can be repeated through analysis. Consider a lowpass filter with 
a frequency response 


H(jw) = 



for |<y| < co s /2 
for |<y| > a> s /2 


such as that illustrated in Fig. 6.1 lc. The frequency spectrum of the filter output is given by 


X(jo>) = H(jo>)X(ja>) 


(6.48) 
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(see Eq. (10.6a)). Thus from Eqs. (6.43b) and (6.48), we can write 

oo 

X{jco) = H(ja>) J2 x(nT)e- jmnr 

n =—oo 


and hence 


x(t) = T~ x 


OO 

H(jco) Y x(nT)e~ jlonT 

n =—oo 


oo 

= Y x {nT)T- l [H{jcS)e - ja>nT ] 

n——oo 


(6.49) 


The frequency response of the lowpass filter is actually a frequency-domain pulse of height T and 
base (d s , that is, // (jo>) = Tp„ h (a>) as shown in Fig. 6.1 lc and hence from Table 6.2, we have 


T sin(<y s f/2) 

IT t 


H(jw) 


and from the time-shifting theorem of the Fourier transform (Theorem 2.9), we obtain 


T sin[tu i (r — nT)/2\ 
jx(t — nT) 


H{joo)e- jtonT 


Therefore, from Eqs. (6.49) and (6.50), we conclude that 


x(t) = 


OO 

x(nT ) 

n =—oo 


sinl&i^f — nT)/2] 
co s (t - nT)/2 


(6.50) 


(6.51) 


For an ideal lowpass filter, the frequency spectrum in Fig. 6.11<i is exactly the same as that in 
Fig. 6.11a and thus the output of the ideal filter in Fig. 6.10 must be x(t). In effect, Eq. (6.51) is 
an interpolation formula that can be used to determine signal x(t) from its values x(nT). That this, 
indeed, is the case, we note that the right-hand side in Eq. (6.51) assumes the values of x(t) for 
—oo < n < oo if t = nT since lim A .^o sinx/x = 1. 

Note that the above analysis provides the standard method for the reconstruction of the original 
signal from an impulse-modulated version of the signal and, as will be shown below, it can also be 
used to reconstruct the continuous-time signal from a discrete-time version. 


6.7 ALIASING 

If 


X(jm) ^ 0 for \w\ > y 

as in Fig. 6.12a, for example, frequencies pertaining to the shifted copies will move into the baseband 
of X(jco) as depicted in Fig. 6.12 b. As a result, X(jco) (dashed curve in Fig. 6.1 2b) will no longer be 
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(c) 

Figure 6.12 Aliasing of an impulse-modulated signal: (a) X(jcu), ( b ) shifted copies of X(ja>)/T and 
X(jcu), (c) lowpass-filtered version of X(jto). 


equal to X(ja>) over the baseband, and the use of an ideal lowpass filter will at best yield a distorted 
version of x(t), as illustrated in Fig. 6.12c. The cause of the problem is aliasing, which was explained 
in some detail in Sec. 5.5.4. 


6.8 GRAPHICAL REPRESENTATION OF INTERRELATIONS 

Various important interrelations have been established in the preceding sections among continuous¬ 
time, impulse-modulated, and discrete-time signals. These are illustrated pictorially in Fig. 6.13. 
The two-directional paths between x(t ) and x(« T) and between X(jco) and X D (z) render the Fourier 
transform applicable to DSP. The two-directional paths between x{t) and x(n T ) and between Xi j(o) 
and X D (z ) will allow us to use digital filters for the processing of continuous-time signals. And the 
path between X(s) and Xd(z) will allow us to design digital filters by using analog-filter method¬ 
ologies. 
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Figure 6.13 Interrelations between continuous-time, impulse-modulated, and discrete-time signals. 


6.9 PROCESSING OF CONTINUOUS-TIME SIGNALS USING 
DIGITAL FILTERS 

Consider the filtering scheme of Fig. 6. 14 a where .Si and ,Si are impulse modulators and Fa and fpp 
are analog filters characterized by transfer functions Ha(s) and //| p(,v), respectively, and assume that 
Flp is an ideal lowpass filter with a frequency response 


Hu>{jco) = 



for |<y| < co s /2 
otherwise 


(6.52) 


Filter Fa in cascade with impulse modulator S 2 constitute a so-called impulse-modulated filter Fa ■ 
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X(t) x(t) x(nT) y(nT) y(t ) y(t) 



Figure 6.14 The processing of continuous-time signals: (a) Using an impulse-modulated filter, (b) using a 
digital filter. 

By analogy with Eqs. (6.42e) and (6.46b), the impulse response and transfer function of filter 
F A can be expressed as 

OO 

h A (t) = ^ h A (nT)8(t — nT) (6.53a) 

n =0 


and 

Jl /Q I \ J OO 

Ha(s) = H D (Z ) = + ~ Y, Ha ^ s + J n( ^ ( 6 ' 53b ) 

n——oo 

respectively, where 

h A (t) = C~ l H A {s) /!a( 0+) = lim [s//a(s)] 

s—too 

H d {z) = Zh A (nT) z = e sT 

The transfer function of the cascade arrangement of the impulse-modulated filter and the 
lowpass filter is simply the product of their individual transfer functions, that is, H a (s)Hlp(s), and 
hence the Laplace transform of y{t) can be obtained as 

Y(s) = H a ( S )H lp (s)X(s) 

Therefore, the Fourier transform of y(t) in Fig. 6.14a is 


Y(joj) = H A (jco)H LP (joj)X(jw) 


( 6 . 54 ) 
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and if 


x(0+) — /ia(0+) — 0 


(6.55a) 


and 


X(ja >) = H A (ja >) = 0 for \a>\ > co s /2 (6.55b) 

then X(ja >) and H A (ja>) are periodic continuations of X(ja>)/T and H A (ja>)/ T , respectively, and 
thus Eqs. (6.45a), (6.53b), (6.55a), and (6.55b) give 

X(jco)= Y X U“>) and H A (jco) = ^H A (jaj) for M < y (6.56) 
Hence Eqs. (6.54), (6.52), and (6.56) give 

Y(jco) = ^H A (jw) ■ T 2 • ^X(jaj) = H A (Jw)X(jct) for \w\ < m s /2 (6.57a) 

and 

Y(jco) = 0 for |<w| > co s /2 (6.57b) 

Now from the assumptions made in Eqs. (6.55a) and (6.55b), H A (jco)X(j(o ) = 0 for \co\ > a> s /2 
and thus Eq. (6.57b) is redundant, i.e., Eq. (6.57a) holds for all frequencies. On replacing jco by .v in 
Eq. (6.57a), the .^-domain representation of the impulse-modulated filter can be obtained as 

Y(s) = H a (s)X(s) 

After much science and some extravagant use of components, we have managed to construct 
an impulse-modulated filter that operates exactly like analog filter F A in Fig. 6.14a. At first sight, 
this appears to be an unnecessarily complicated and highly redundant design of an analog filter 
that would certainly not excite the market place if offered as a commercial product! However, an 
important feat has been achieved in the process as will now be demonstrated. From Eq. (6.53b), we 
note that, just like a digital filter, an impulse-modulated filter can be characterized by a discrete-time 
transfer function and by replacing the impulse-modulated filter in Fig. 6.14a by an equivalent digital 
filter, the filtering of continuous-time signals by means of digital filters can be achieved. On the other 
hand, given an analog filter whose transfer function, H A (s), satisfies the conditions 

h A ( 0+) = 0 and H A (ja>) ^ 0 for \w\ > co s /2 

a corresponding impulse-modulated filter can be obtained and from that an equivalent digital filter 
can be deduced that has approximately the same frequency response as the analog filter. Therefore, 
digital filters can be designed by using analog-filter methodologies. This possibility will be explored 
further in Chap. 11. 

A digital-filter implementation of Fig. 6.14 a can be obtained by replacing the impulse- 
modulated filter by a digital filter together with suitable interfacing devices, as shown in Fig. 6.14£>. 
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The cinalog-to-digital and digital-to-analog converters are required to convert impulses into num¬ 
bers and numbers into impulses. The input lowpass filter is used to bandlimit x(t ) (if it is not already 
bandlimited) to prevent aliasing errors. The detailed operation of such a filtering scheme is illustrated 
by the following example. 


Example 6.5 


The configuration of Fig. 6.14 b is used to filter a periodic signal given by 


r(t) = x(t + nro) where x(t) = 


sinruof for 0 < t < to/2 
0 for — To /2 < t < 0 


1 for 0 < \u>\ < 6(Do 

0 otherwise 


where wq = 2n/ tq. The lowpass filters are characterized by 
Hu>(jco) = 

and the digital filter has a baseband response 
H D {e j “ T ) = 


T for0.95<wo < M < 1.05<wo 

0 otherwise 


Assuming that co s = 12&>o, find the time- and frequency-domain representations of the signals 
at nodes 1, 2, ..., 7. 

■ Solution 

Node 1 From Example 6.1, part (b), the Fourier series of the signal can be expressed as 


*i(f) = \a 0 + E a„ cosna>ot + b n sinnwot 


(6.58) 


n= 1 


n= I 


where 


fl 0 


7r 


2 

37r 
2 

35rr 


fl 3 = 0 a 4 = — 


157T 


ci-] = 0 ■ • ■ 


= 0 a 2 — 

a$ = 0 a 6 = — - 

b2 — 0 £>3 = 0 &4 = 0 i >5 = 0 b(, = 0, • • 

z 

and from Table 6.2, the Fourier transform of x\{t) can be obtained as 

OO 

Xi(ja>) = Tx \(?) = ao7rS(o)) + a n jr[8(a) + nco o) + 8(co — nco o)) 


b\ = 


k=\ 


+ jb n rc[8(fl) + na>o) — 8(ai — ncop)] m (6.59) 


k= 1 
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Node 2 The bandlimiting filter will remove all frequencies equal to or greater than 6&>o 
and hence Eq. (6.58) gives 


x 2 (t) = \a 0 + E a n cos ncoot + b„ sin moot 


n =1 


n= 1 


11 2 2 

=-1— sin coot — iff- cos 2u>ot -cos 4coq t 

7T 2 3jt 157T 


and 


X 2 (jco) = Tx 2 (t) 


= 2S(co) + j - [5(<o + co 0 ) ~ 8(co - coo)] - - [8(co + 2<wq) 

2 

+<$(« - 2(W 0 )] - — [<5(® + 4(w 0 ) + S(co - 4a>o)] ■ 

Nodes 3 and 4 The output of the impulse modulator is obtained from Eq. (6.42d) as 

OO 

*3(0 = E x{nT)8(t — nT) 


/ 11 2 2 \ 

= ) -1—sin<wo«T- cos2coonT -cos4<wo«T ) <5(/ — nT) 

x- —^ V 7T 9 97r I S7T J 


Thus 


11 . 2 2 

x\ (nT) = -1 — sin coqh T — ■- — cos2coonT -cos 4coqiiT 

n 2 3 jt 157T 


and from Eq. (6.45a), we have 

j 

X-i(joo) = X 4 (e ]wT ) = — ^ X 2 (j'co + jnco 0 ) 


i 00 r 

1 V-—J 7 T 

= - 2^ 2<5(<w + ncos) + j — [S(ftj + nco s + co 0 ) - 8(co + nco s - <w 0 )] 


-[<5(<w + nco s + 2a>o) + 8(co + noo s - 2® 0 )] 


- — [<5(cw + nco s + 4u>o) + 8(co + nco s - 4<wo)] 
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Nodes 5 and 6 The bandpass digital filter will reject all components except those with 
frequencies ±wq ± nco s and it will also provide a gain of T, and so 


X 5 (e jmT ) = X 6 {ja>) 


E tc 

j — [S(co + nco s + wo) - <5(w + nco s - w 0 )] 


Thus, from Table 6.2, we get 

X 5 (nT) = ^ sina>onT m 


and 

X6(?) = - (sinwo nT)8(t — nT) m 

n——oo 

Node 7 Finally, the lowpass filter at the output will reject all components with frequencies 
outside the baseband, and as a result 

Xj(joj) = &>0 -* — ~ tt, °^ " 

and 


x 7 (t) = j sin wot ■ 

The various signal waveforms and amplitude spectrums are illustrated in Fig. 6 . 15a and 
b, respectively. 


6.10 PRACTICAL A/D AND D/A CONVERTERS 

A practical implementation of the analog-to-digital interface is shown in Fig. 6.16 a. The function 
of the sample-and-hold device is to generate a signal of the form 

OO 

x(t) = x(nT)p T (t — nT) 

n=—o o 


such as that illustrated in Fig. 6.16Z>. The function of the encoder, on the other hand, is to convert 
each signal level x(nT) into a corresponding binary number. Since the number of bits in the binary 
representation must be finite, the response of the encoder denoted by x q (nT) can assume only a finite 
number of discrete levels; that is, x q {nT) will be a quantized signal. Assuming that the encoder is 
designed such that each value of x(nT) is rounded to the nearest discrete level, the response of the 
encoder will be of the form depicted in Fig. 6.16c. We can write 


x q (nT ) = x(nT) — e(nT) 
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Figure 6.15 Example 6.5: (a) Time-domain representations of signals at nodes 1,2, ... ,7, (b) amplitude spectrums of 
signals at nodes 1, 2, ... , 7. 
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Practical A/D converter 


x(t) o- 







Sample 
and hold 
device 

x(t) 

Encoder 










-O x a (nT) 


(a) 



—e(nT) 


x(t) o- 







Ideal 

x(nT) f 




A/D 

' *' vd 



-o x q {nT) 


(d) 


Figure 6.16 Analog-to-digital interface: (a) Practical A/D converter, ( b) response of a practical A/D 
converter, (c) output of encoder, (d) model for a practical A/D converter. 


where e(nT) is the quantization error. Hence a practical A/D converter can be represented by the 
model of Fig. 6.16 cl, where — e{nT ) can be regarded as a noise source. The effect of this noise source 
on the filter response will be considered in Sec. 14.5. 

The purpose of the D/A converter in Fig. 6.14/? is to generate an impulse-modulated signal 
y(t ) like the one shown in Fig. 6.17a where the impulse functions are very thin and very tall pulses 
as defined in Sec. 6.2.1. However, a practical D/A converter will produce a waveform of the form 
illustrated in Fig. 6.17b where the pulses may not be very thin or very tall. Such a waveform can be 
represented by the equation 


OO 

y(t) = ^2 y(nT)p x {t - nT) 


n= —oo 
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Practical D/A converter 


y(nT) o- 








Ideal D/A 

converter 

y(t) 

f p 











-o y(t) 


(c) 



id) 


Figure 6.17 Digital-to-analog interface: (a) Response of an ideal D/A converter, (b) response of a practical D/A converter, 
(c) model for a practical D/A converter, (d ) amplitude response of fictitious filter F p . 
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From Table 6.2 


fPz(t) = 


2 sin(<yr/2) 


and by using the time-shifting theorem (Theorem 2.9), we obtain 

Tp ,0 - »r> = 2siT ' < - m/I > e -l~r 

CO 

Hence the Fourier transform of y(t) can be obtained as 

oo 

Y{j oj) = y y{nT)f p x {t - nT) 

n=—oo 

2 sin(o;r/2) 


co 


^ y(nT)e 1 


conT 


The above equation can be expressed as 

Y(joj) = H p (jco)Y(jco ) 


where H p (jm) = % sin(a ^/^ and Y(jm)= y y(nT)e ja>nT 

mx 2 ' 

‘ n= — OO 

By analogy with Eq. (6.43a), we can write 

OO OO 

Y(Jm) = y y(nT)e-j™ T = T y y(nT)S(t - nT) = Ty(t) 

n=—o o H ——oo 


where y(t) is an impulse-modulated signal of the type that would be produced by an ideal D/A 
converted. Therefore, a practical D/A converter can be modeled in terms of an ideal D/A converter 
followed by a fictitious filter F p , as depicted in Fig. 6.17c, with a frequency response H p (jo>). The 
amplitude response of this filter is given by 


1 ^ 0)1 = r 


sin (cur/2) 

MX/2 


(6.60) 


and is sketched in Fig. 6.17c/. Clearly, a practical D/A converter will introduce distortion in the 
overall amplitude response often referred to as sine distortion which is actually a form of amplitude 
distortion (see Sec. 5.7). 

The effect of sine distortion can be easily illustrated if we assume that the digital filter in 
Fig. 6.14/? is a bandpass filter with an ideal amplitude response such as that in Fig. 6.18«. Due to 
sine distortion, the amplitude response of the D/A converter will assume the form in Fig. 6.18Z? and 
thus the overall amplitude response of the bandpass filter in cascade with the D/A converter will 
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Figure 6.18 Effect of sine distortion: (a) Amplitude response of an ideal bandpass filter, ( b ) response of a 
practical D/A converter, (c) overall response of bandpass filter in cascade with D/A converter. 


be the product of the amplitude responses in Fig. 6.18« and b, as depicted in Fig. 6.18c. Evidently, 
the D/A converter will introduce a reduction in the overall gain, which would tend to increase with 
frequency. 

Sine distortion can be reduced in a number of ways. One possibility would be to make the 
pulse width r as small as possible which would move the notch at a> = 2n /r to a higher frequency. 
Another possibility would be to design the output lowpass filter in Fig. 6.14h such that 


\H„Uw)H LP (jco)\ 


1 for \u>\ < «j/2 

0 otherwise 


On the other hand, in an application like that in Example 6.5 it is sometimes possible to design the 
digital filter such that the digital filter in cascade with the D/A converter satisfies the desired filtering 
specifications. For example, the amplitude response of the bandpass filter can be designed to increase 
as the frequency is increased so as to compensate for the reduction in the amplitude response of the 
D/A converter, as illustrated in Fig. 6.19. Such a design would necessitate the use of optimization 
and an actual design of this type can be found in Sec, 16.7 (see Example 16.3). 
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Gain 


co 

(c) 

Figure 6.19 Compensation for sine distortion: (a) Amplitude response an ideal bandpass filter, ( b) response 
of a practical D/A converter, (c) overall response of bandpass filter and D/A converter. 


Example 6.6 


A bandpass digital filter with an idealized amplitude response 


( < icr 3 

Mbp(o>) < = 1 

[< icr 3 


for 0 < a> < 1200 rad/s 
for 1500 < a> < 3000 rad/s 
for 3300 < a> < 5000 rad/s 


is used in the DSP scheme shown in Fig. 6.14b. The output lowpass filter is ideal with a 
constant passband gain of 1 /r and the D/A converter will produce an output waveform of the 
type shown in Fig. 6.17 b with a pulse width r = 0.3 ms. ( a ) Find the maximum passband 
loss introduced by the D/A converter in dB if the sampling frequency is co s = 10 4 rad/s. 
(b) Find the minimum sampling frequency that would keep the maximum passband loss to a 
value equal to or less than 0.1 dB. 
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■ Solution 


(a) The overall amplitude response of the DSP system is given by 


M(o>) = M bp (co) ■ \H p (jco)\ ■ \H LP (jco)\ 


and from Eq. (6.60), we have 


M(a>) — Mbp(cl>) ■ x 


sin(tt>r/2) 

o>r/2 


1 

T 


= Mbp(co) ■ 


sin(a>r/2) 

mx 


Thus the D/A converter will introduce a loss which increases with frequency. The maxi¬ 
mum passband loss will occur at the upper edge of the passband, i.e., at a> — 3000 rad/s, 
and hence 


Gain = M(3000) = 


sin(3000 x 0.3 x IO- 72 ) 


3000 x 0.3 x IO -72 


= 0.9666 


Loss = 20 log-= 0.2951 dB ■ 

5 0.9666 

(b) The loss will be equal to or less than 0.1 dB at a> = 3000 if 

CD x 12 

Loss = 20 log —-— < 0.1 

sin(a;r/2) 

3000r/2 

= 20log , _ ' ... < 0.1 


Hence we require 


sin(3000r/2) 


3 ° 00r//2 < 10 01/2 ° = 1.011579 

sin(3000r/2) “ 


A short MATLAB program will reveal that 

3000r/2 < 1.011579 sin(3000r/2) 

ifr < 1.7525xl0“ 4 and,therefore, co s > 27(1.7525x 10“ 4 ) = 3.5853x 10 4 rad/s. 
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PROBLEMS 

6 . 1 . (a) Assuming that 


8(co) = lim p m (a>) 


where 



1 for \a>\ < m/2 

0 otherwise 


and e is a very small but finite constant, show that 8(co) is an even function of at, that is. 


8(-co) = 8(a>) 


( b ) Using the above definition, prove part (a) of Theorem 6. IB. 

(c) Prove part (b) of Theorem 6. IB. 

( d ) Prove part (c) of Theorem 6. IB. 


6 . 2 . (a) A periodic signal x(t) can be represented by Eq. (6.30) with 



for — r/2 < t < t/2 


otherwise 


Obtain the Fourier transform of x(t). 
( b ) Repeat part (a) if 


x(t) = Pr /2 {t+\x)~ p r ,2 (t - \x) 


6 . 3 . (a) A periodic signal x(t) can be represented by Eq. (6.30) with 



1 for -r/2 < t < —r/4 

2 for -r/4 < t < r/4 

1 for r/4 < t < r/2 

0 otherwise 


Obtain the Fourier transform of x(t). 
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( b) Repeat part (a) if 


x(t) = 



for — 3t/8 < t < — t/4 
for — r/4 < ; < t/4 
for t/4 < t < 3t/8 
otherwise 


6.4. (a) A periodic signal x(t) can be represented by Eq. (6.30) with 


x(t ) = 


for — t/2 <t< — ti/2 
for ti/2 <t< t/2 
otherwise 


where t > Tj. Obtain the Fourier transform of x(f). 
(6) Repeat part (a) if 


x(t) = 



for —t/2 < t < —ti/2 
for Tj/ 2 < t < t/2 
otherwise 


where r > tj. 

6.5. (a) A periodic signal x(t) can be represented by Eq. (6.30) with 


x(t) = 


for —t/2 <t< — tt/ 2 
for —Ti/ 2 <t< Ti/2 
for t 2 /2 <t< t /2 
otherwise 


where t > t 2 > Ti . Obtain the Fourier transform of x(f). 
(b) Repeat part (a) if 


x(t) = 



for —t/2 <t< — t 2 /2 
for —Ti/2 < t < T\/2 
for t 2 /2 < t < t/ 2 
otherwise 


where t > t 2 > Ti. 

6.6. (a) A periodic signal 1(f) can be represented by Eq. (6.30) with 


{ sin cuof 
0 


for 0 < t < t 0 /4 
otherwise 


where a>o — 2tc /tq. Obtain the Fourier transform of x(f). 
( b ) Repeat part (a) if 


J cos<M 0 f for 0 < t < t 0 /4 

\ 0 otherwise 


where £u 0 = 2 tc / t 0 . 

6.7. (a) A periodic signal x(t) can be represented by Eq. (6.30) with 


Jsinhar for -t/2 < t < t/2 

1^0 otherwise 


Obtain the Fourier transform of x{t). 
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(b) Repeat part ( a ) if 


fcosh at for — r/2 < t < r/2 

|^0 otherwise 


6 . 8 . (a) Find the Fourier transform of the periodic signal shown in Fig. P6.8a where a>o = 2n/r 0 . Sketch the 
amplitude spectrum of the signal. 

( b ) Repeat part(a) for the signal shown in Fig. P6.8fc. 



(a) 



Figure P6.8o and b 

6.9. (a) Find the Fourier transform of the periodic signal shown in Fig. P6.9o. Sketch the amplitude spectrum. 
( b ) Repeat part (a) for the signal shown in Fig. P6.9 b. 




5> T o 

2 2 


(b) 


Figure P6.9o and b 





















314 DIGITAL SIGNAL PROCESSING 


6.10. (a) Find the Fourier transform of the periodic signal shown in Fig. P6.10a. Sketch the amplitude spectrum. 
(b) Repeat part (a) for the signal shown in Fig. P6.10fc. 




T o T o 

2 2 


(b) 

Figure P6.10a and b 


6.11. (a) Find the Fourier transform of the periodic signals shown in Fig. P6.11a. Sketch the amplitude 
spectrum. 

( b ) Repeat part (a) for the signal shown in Fig. P6.1 lb. 



(a) 



Figure P6.11« and b 
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6.12. Find the Fourier transforms of the periodic signals 

(a) 


x(t) = cos 2 co 0 t + cos 4 a>ot 


(b) 


x(t) = i + sin cogt + ^ sin 2 coot + cos 4 coot 


6.13. Find the Fourier transforms of the periodic signals 

(a) 


x(t) = (sin 5coot cos coot) 2 


(b) 


x(t) = (cos 3co 0 t cos 2co 0 t) 2 


(c) 


x(t) = (cos oo 0 t + j sincuoO" 


6.14. (a) Show that the Fourier series kernel in Eq. (6.28) is periodic with period 7. 

( b ) Show that the signal in Eq. (6.30) is periodic with period 7. 

6.15. (a) Show that the periodic signal in Prob. 6.2, part (a), satisfies Theorem 6.3. 

(b) Repeat part (a) for the periodic signal in Prob. 6.2, part ( b ). 

6.16. (a) Show that the periodic signal in Prob. 6.3, part (a), satisfies Theorem 6.3. 

(b) Repeat part (a) for the periodic signal in Prob. 6.4, part (a). 

6.17. (a) Show that the periodic signal in Prob. 6.7, part (a), satisfies Theorem 6.3. 

(b) Repeat part (a) for the periodic signal in Prob. 6.8, part ( b ). 

6.18. (a) Signal x(t) is obtained by applying impulse modulation to the nonperiodic signal in Prob. 6.3, part (a). 

Obtain the Fourier transform of x{t ) in closed form if r = 5 7. 

( b ) Repeat part (a) if x = 67. 

6.19. (a) Signal x{t) is obtained by applying impulse modulation to the nonperiodic signal in Prob. 6.4, part (a). 

Obtain the Fourier transform of x(t) in closed form if r = 6 T and T\ — T. 

(b) Repeat part (a) if r = IT and n = 1.57’. 

6.20. (a) Signal x(t) is obtained by applying impulse modulation to the nonperiodic signal in Prob. 6.7, part (a). 

Obtain the Fourier transform of x(t) in closed form if co s = 2 n/T = 18 rad/s and r = 1.0 s. 

(b) Repeat part (a) if co s = 2n/T = 20 rad/s. 

6.21. (a) Find the Fourier transform of 


x(t) = p r {t - 27) 


where t = (N — 1)7/2 and N is odd. The sampling frequency is co s = 2n/T. 

(b) Find the Fourier transform of the impulse-modulated signal x(t) in closed form. 

(c) Find the Fourier transform of x{t) using Poisson’s summation formula. 


6.22. Repeat parts (a), ( b ), and (c) of Prob. 6.21 if 



a + (1 — a) cos — for |f| < x 


0 otherwise 


r 


assuming that co s = 2jr/7. 

6.23. (a) Find the Fourier transform of 


x(t) = u(t) 2e 


,—0.51+0.1 


The sampling frequency is co s = 2n/ 7. 
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( b) Find the Fourier transform of x{t) in closed form. 

(c) Find the Fourier transform of x{t) using Poisson’s summation formula. 
6.24. The signal 


x(t) = u(t)e ' cos 2 1 


is sampled at a rate of 2n rad/s. 

(a) Find the Fourier transform of x(t). 

( b ) Find the Fourier transform of x (f) in closed form. 

(c) Show that 


1 

= X D (e^ T ) = - + ^ 

k=—oo 


1 + j(a> + Ink) 

[1 + j(co + 2nk)] 2 + 4 


(d) By evaluating the left- and right-hand sides for a number of frequencies in the range 0 < co < u> s /2, 
demonstrate that the relation in part (c) holds true. (Hint: The left-hand side is the z transform of 
x(nT) evaluated on the unit circle |z| = 1. The right-hand side is, as can be seen, an infinite series 
but the magnitudes of its terms tend to diminish rapidly and eventually become negligible as \k\ 
increases.) 

6.25. (a) Find the Fourier transform of 


x(t) = u(t)e °' 01f sin2jrf 


(b) Find the Fourier transform of x(t) in closed form assuming a sampling frequency a> s — 107r rad/s. 

(c) Repeat part ( b ) using Poisson’s summation formula. 

6.26. A nonperiodic pulse signal x(t) assumes the form depicted in Fig. P6.26. 

(a) Obtain a representation for x(t) in the form of a summation. 

(b) Find the Fourier transform of x{t). 

(c) Obtain the Fourier transform of impulse-modulated signal x(t ) in the form of an infinite summation. 



Figure P6.26 
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6.27. (a) Obtain the Fourier of 


x(t) = 



for |t| < t 
otherwise 


where r = (N — 1 )T /2 and T = 2n/ai s . 

(b) Using Poisson’s summation formula, show that 


X(joi) 


8 , oi{N - l)T 

— -- sin - 

ai 2 (N - 1)T 2 4 


oi , 

for \oi\ < — 
2 


if ai s 16 /tcN. (Hint: Note that X(jai) —»■ 0 if ai s 16/nN.) 

6 . 28 . The filtering scheme of Example 6.5 is used to process the signal of Fig. P6.8 b. 

(a) Assuming that a>o = 2n/z a , find the time- and frequency-domain representations of the signals at 
nodes 1, 2,..., 7. 

(b) Sketch the various waveforms and amplitude spectrums. 

6 . 29 . The DSP system of Fig. 6.14Z? employs a bandpass digital filter with an amplitude response like that 
depicted in Fig. P6.29. The output of the D/A converter is of the form shown in Fig. 6.11b, where 
r = 3.0 ms and the sampling frequency is 1000 rad/s. 

(a) Assuming an ideal output lowpass filter with a constant passband gain of 1 /t, sketch the overall 
amplitude response of the configuration indicating relevant quantities. 

( b ) The gain at a> = 300 rad/s is required to be equal to or greater than 0.99 times the gain at a> = 
200 rad/s. Find the maximum permissible value of r. Hence, calculate the lowest sampling frequency. 


1.0 - - 

Gain 

0.1 - - 

i r 

200 300 

Figure P6.29 


I 

500 


ai, rad/s 


6.30. A digital filter is connected in cascade with a practical D/A converter as shown in Fig. 6.14 b. The amplitude 
response of the filter is illustrated in Fig. P6.30a and the time-domain response of the D/A converter is a 
staircase waveform of the type shown in Fig. P6.307>. The sampling frequency is ai s = 8 rad/s. 

(a) Calculate the overall gain of the cascade arrangement for ai — 0, 2 — e, 2 + e, 3 — e, 3 + e, and 
4 rad/s (e is a small positive constant, say less than 0.0001). 
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(6) Sketch the amplitude response of the arrangement, indicating relevant quantities. 


Gain 


1.0 

0.8 

0.6 

0.4 

0.2 

0 


1.0 2.0 3.0 4.0 w, rad/s 

(a) 



(b) 


Figure P6.30 


6.31. The DSP system of Fig. 6.146 uses a bandpass filter characterized by the transfer function 


3 

h(z)=H 0 n 

i =i 


a 0 j + aijz + z 2 
b 0j + bijz + z 2 


and has a passband ripple 6 of 1 dB. The sampling frequency is 20 rad/s. The output lowpass filter is ideal 
with a constant passband gain of 1/t and the D/A converter will produce an output waveform of the type 
shown in Fig. 6.176. 

(а) Find the amplitude response of the system, including the effect of the D/A converter, assuming a 
pulse duration r = T /100 in the waveform of Fig. 6.176 . 

(б) Repeat part (a) if r = T. 

(c) Find the lowest sampling frequency that would assure a maximum passband ripple that does not 
exceed 1.2 dB over the passband range 4.0 to 6.0 rad/s. 


6 This is the difference between the maximum and minimum passband gain in dB. 
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Table P6.31 Coefficients of H(z) (Prob. 6.31) 


i 

a »i 

Cl\j 

b 0 j 

by 


1 

-1.0 

0.0 

7.190253 E - 1 

7.461412£ - 

8 

2 

1.0 

-1.691081 

8.670819£ - 1 

5.623427 E - 

1 

3 

1.0 

1.691082 

8.670819£ - 1 

-5.623425 E - 

1 

H 0 

= 1.640287£ - 2 
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CHAPTER 

7 


THE DISCRETE 
FOURIER 
TRANSFORM 


7.1 INTRODUCTION 

Given a finite-duration discrete-time signal, a corresponding periodic discrete-time signal can be 
generated which has a discrete Fourier transform (DFT) that happens to be a discrete-frequency 
spectrum. Thus given a signal that can be represented by a sequence of numbers a spectral charac¬ 
terization of the signal can be obtained, which can also be represented by a sequence of numbers. 
Consequently, the DFT is highly amenable to processing by computers and digital signal processors. 
The DFT turns out to be a sampled version of the frequency spectrum of the original finite-duration 
nonperiodic signal and, therefore, it is a very important tool for digital signal processing (DSP). 

In a landmark paper published in 1965, Cooley and Tukey demonstrated that the direct eval¬ 
uation of the DFT entails a considerable amount of redundancy and through an ingenious method 
that has come to be known as the fast Fourier transform (FFT), these authors and others [1-4] have 
shown that a huge amount of computation can be eliminated without degrading the precision of the 
DFT in any way. The FFT approach renders a highly amenable tool for computation also a very 
efficient one and for these reasons the DFT has found widespread applications over the years. 

By analogy with the convolution summation described in Sec. 4.6, periodic convolutions can 
be constructed, which can also benefit greatly through the application of the FFT [5], Through the 
periodic convolutions, some highly efficient implementations of finite-duration impulse response 
(FIR) filters can be achieved. 
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x(nT) 



-NT u NT 2NT 3 NT 


Figure 7.1 A periodic discrete-time signal. 

This chapter deals with the definition of the DFT and inverse-DFT and their properties. The 
relations between the DFT and the z transform, the continuous-time Fourier transform (CFT), and 
Fourier series are then established. The chapter also deals with a technique known as the window 
technique which enables the processing of long- or infinite-duration signals through the use of the 
FFT method. Periodic convolutions and their efficient computation through the use of FFTs are then 
discussed. 

7.2 DEFINITION 

A discrete-time signal x(nT) is periodic if it satisfies the condition 

x(nT + rNT ) = x(nT) for 1, 2,... , oo 

where N is an integer and NT is said to be the period of the signal. A periodic discrete-time signal 
is illustrated in Fig. 7.1. 

The DFT of a periodic signal x(nT ) is defined as 

iV-l 

X(jkQ) = x{nT)W~ kn = Vx{nT ) (7.1) 

n =0 

where W = e j2n/N £2 = — and co s = — 

N T 

In general, X(jkQ) is complex and can be put in the form 

X(jk£2) = A(kQ)e J,p{kn> 

where A(k£2) = \X(jk£2)\ and (f>{kQ.) — arg X(jk£T) 

are discrete-frequency functions. The functions A(k£l) and 4>(kQ) are referred to as the amplitude 
spectrum and phase spectrum of x(n T). respectively. They are entirely analogous to the corresponding 
spectrums of continuous-time and nonperiodic discrete-time signals. 

7.3 INVERSE DFT 

The function x(nT) is said to be the inverse DFT (IDFT) of X( jkQ) and is given by 

] n-i 

x{nT) X(jkZl)W kn = V~ l X{jkQ) 

V k =0 


(7.2) 
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The validity of the inverse DFT can be demonstrated by eliminating the DFT in Eq. (7.2) using 
Eq. (7.1). We can write 


n- t 


N -1 


i £ *0= jE 


£=0 


A/ - 


&=0 

W-l 


AT-1 


x(mT)W 

m =0 

= iE^ r )E^" 


w 


kn 


—m) 


m =0 


k=0 


where one can show that 


iv-i 


\yk(n-m) _ 


k =0 


IV for m — n 

0 otherwise 


1 N ~ l . 

(see Prob. 7.1). Therefore — X(jk£2)W kn = x(tiT) 

k =o 


7.4 PROPERTIES 

7.4.1 Linearity 

The DFT obeys the law of linearity, that is, for any two constants a and b, 
V[ax(nT ) + by(nT )] = aX(jkQ) + bY(jk£l) 


7.4.2 Periodicity 

From Eq. (7.2) 

IV-1 N -1 

X[j(k + rN)C2] = ^x(nr)W“ ( * +rA °" = ^ x(nT)W~ k " 

n =0 «=0 

= * 0 '*£ 2 ) 

since W~ rnN = 1. In effect, X(jkQ) is aperiodic function of k£2 with period N£2 (— a> s ). 


7.4.3 Symmetry 

The DFT has certain symmetry properties that are often useful. For example, assuming that x(nT ) is 
real, we have 


IV—1 


n—0 


X[j(N - k)Q] = ^2x(n T )W- (N ~ k)n = Yx(nT)W 

n—0 
~N-1 

= ^\?(«T)W 


r—kn 


n—0 


= X*(jkQ) 
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and as a result 

3\e X[j(N - fc)£2] = IHe X(jkQ.) 3m X[j(N - k)Q] = - 3m X(jkQ) 
A[(1V — A:)£2] = A(k£2) <p[(N — Ai)f2] = —<p(k£i) + 2nr 

where r is any integer. If it (nT) is real and, in addition, 

x(nT) = ±x [(N — n)T] 

we obtain 


N-l 


X(jkQ) = ±^x[(N -n)T]W~ kn = ±^2x(mT)W- 


k(N-m) 


n =0 
N-l 


m= 0 


= ± 


(nT)W 


—kn 


n=0 


= ±X*(jkS2) 


Thus if 


we have 


and if 


x(nT) = x[(lV — n)T] 


3m X(jkQ.) = 0 


x(nT) = —x[{N — n)T] 


then 


me X( jkQ) = 0 


Example 7.1 


Find the DFT ofx(nT) if 


x{nT) 


lot 2 < n < 6 
for n = 0, 1, 7, 8, 9 


assuming that N = 10. 
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i Solution 

By noting that the DFT is a geometric series (see Sec. A.5) with a common ratio W ~ k , 
Eq. (7.1) gives 


X(jkQ) = J2 W~ kn = 

n—2 


w~ 2k — w~ lk 


w 


-k 


= c -iAnk/5 sin(7T/c/2) 
sin(jrA:/10) 

The amplitude and phase spectrums of x(nT) can be obtained as 

sin(7rA:/2) 


A(£S2) = 


sin(7r^/10) 


and 


Auk 

<p(k£T) = Ctc -— where C — 


sin(7T k/2) 

1 if- < 0 

sin(7rA:/10) 

0 otherwise 


and are plotted in Fig. 7.2. 


7.5 INTERRELATION BETWEEN THE DFT 
AND THE Z TRANSFORM 

The DFT is defined in Sec. 7.2 in terms of periodic discrete-time signals. Nevertheless, it can also 
be applied for the analysis of nonperiodic discrete-time signals as long as they are of finite duration. 
Given an arbitrary finite-duration discrete-time nonperiodic signal x(nT ) such that 

x(nT) — 0 for n < 0 and n > M 

where M < N, then a corresponding periodic signal x(nT) with period NT can be readily formed 
as 

OO 

x(nT)= ^2 x(nT + rNT) (7.3) 

r=—o o 

by analogy with Eq. (2.1). Since x(nT) can be derived from x(nT). the DFT of x{nT) must be related 
to the frequency spectrum and, in turn, to the z transform of x(nT) as will now be demonstrated. 
From Eqs. (7.1) and (7.3), we can write 

N— 1 oo oo N—l 

XUkQ) = x(nT + rNT)W~ kn = ^ ^ x(nT + rNT)W~ kn 

n =0 / =—oo r =—oo n =0 
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x(jlT) 



V) 


A(k£2) 




(c) 


Figure 7.2 DFT of x(nT) (Example 7.1): (a) Periodic discrete-time signal, ( b ) amplitude spectrum, 
(c) phase spectrum. 

and by letting n = m — rN , we have 

oo rN+N—\ 

X(jkQ) = Y x(rnT)W- k(m - rN) 

r=—o o m=rN 

-1 N-\ IN —1 

= • • • + Y xOnT)W~ km +Y x ^ mT W~ km + x(. mT ) w ~ km + ■■■ 

m=—N m =0 m=N 

oo 

= Y x(mT)W~ km 


m =—oo 
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Alternatively, on replacing W by eJ l7T;!N and m by n we have 


oo 


X(jk£2) = ^ x{nT)e 


,—jkQ.nT 


where 


and, therefore. 


X(jkQ) = X D (e jkQT ) 
X D (z) = Zx{nT) 


(7.4) 


In effect, the DFT of a periodic signal x(nT ) is a sampled version of the frequency spectrum of the 
nonperiodic signal x(nT ), which is obtained by evaluating the z transform of x{n T) on the unit circle 
|z| = 1, as shown in Fig. 7.3. 

Through a technique known as zero padding, the above interrelationship can be used to facilitate 
the computation of the frequency spectrum of a finite-duration discrete-time signal to any desired 
resolution, as will now be demonstrated. 

Consider a nonperiodic signal x(nT) which is zero outside the interval 0 to (L — 1 )7’. Such a 
signal has a frequency spectrum 


OO 


L— 1 



If we let co — kco s /N = Ink/NT, we get 


L— 1 


X D (e jkr ° s/N ) = J2 x (nT)e 


,—j2nkn/N 


(7.5) 


Z plane 



3 


Figure 7.3 Relation between X{jk£l) and X D (e jkaT ). 
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Let us construct a periodic signal x(nT) with period NT such that 

( x ( nT ) for 0 < n < L - 1 
x(nT) = < 

10 for L < n < N — 1 

through periodic continuation (see Eq. (7.3)). From the definition of the DFT, we have 


(7.6) 


N -1 

X(jk£2) = x(nT)W~ kn 

n =0 


= Y x ( nl "> e ~ j2nkn/N 

n =0 


If we now compare Eqs. (7.5) and (7.7), we conclude that 

X D (e ika ^ N ) = X(JkQ) 


(7.7) 


(7.8) 


As was shown earlier, the DFT gives a sampled version of the frequency spectrum of a discrete-time 
signal and by increasing the number of zeros in Eq. (7.6), £2 = co s /N is reduced and, consequently, 
a higher density of sample points can be achieved. 

The zero padding technique is illustrated in Fig. 7.4 which shows the DFT of Example 7.1 
with the value of N increased from 10 to 20. As can be seen by comparing Fig. 7.4 b and c with 
Fig. 1.2b and c, the density of samples in the amplitude and phase spectrums is doubled. 


7.5.1 Frequency-Domain Sampling Theorem 

The application of the DFT to DSP is made possible by the frequency-domain sampling theorem 
which is analogous to the time-domain sampling theorem considered in Sec. 6.6 except that the roles 
of time and frequency are interchanged. 

Theorem 7.1 Frequency-Domain Sampling Theorem A z. transform Xi>(z) whose inverse 
satisfies the finite-duration condition 

x(nT ) = Z-'X D {z) = 0 for n < 0 and n>N (7.9) 

can be uniquely determined from its values X i)(e' kilT ) or, equivalently, from the values of the 
DFT ofx(nT), X( jkfl), by virtue ofEq. (7.4). ▲ 

The validity of Theorem 7.1 can be easily demonstrated. If the condition in Eq. (7.9) is satisfied, 
then x(nT) as given by Eq. (7.3) is a periodic continuation of x(nT) and x(nT) can be isolated by 
multiplying x(nT ) by a discrete-time pulse as illustrated in Fig. 7.5. We can write 

x(nT) = [u(nT ) - u(nT - NT)]x(nT) (7.10) 


and so 


X D (z) = Z{[u(nT) - u(nT - NT)]x(nT)} 
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x(nT) 



(a) 


A(kS2) 



4>(kQ) 



(0 


Figure 7.4 Effect of zero padding: (a) Periodic discrete-time signal of Example 7.1 with zero padding, 
(b) amplitude spectrum, (c) phase spectrum. 


Now 


x(nT) = V~ l X(jk£2) where X(jkQ) = X D (e jkS2T ) 


and from Eq. (7.2) 


N -1 


X D (z) = Z \ [ u(nT ) - m(«T - Air)]2 ^ X(jk£2)W‘ 

l ^ Jfc=0 

, w-t 

= — X(jk£2)Z{[u(nT ) - u(nT - A7:T)]W*" 


ifc=0 
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NT 



Figure 7.5 Derivation of x(nT) from x(nT). 

The z transform of the unit-step is given by 

Zu(nT) = — 

z - 1 

Therefore, from the time-shifting and complex-scale-change theorems (Theorems 3.4 and 3.5), we 
have 


X D (z ) 


1 

N 


N -1 

]T X(jkQ) 

k=0 


1 -z~ N 
1 - W k z~ l 


(7.11) 


since W~ kN = 1. 

In summary, if the nonperiodic signal x(nT ) is zero outside the range 0 < nT < (N — 1 )T, 
then the periodic signal x(nT) and its DFT X( jkQ) can be obtained from x(nT ) and Xo(z ) by using 
Eqs. (7.3) and (7.4), respectively. Conversely, x(nT) and X D (z) can be obtained from x(nT ) and 
X(jk£i) by using Eqs. (7.10) and (7.11), respectively, as illustrated in Fig. 7.6. Therefore, x(nT ) 
can be represented by the DFT of x(nT). As a result, any finite-duration discrete-time signal can be 
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x(nT ) 
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T I | 

NT 


nT 


Eq. (7.3) 
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Eq. (7.10) 


x(nT) 
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V 1 


Figure 7.6 Interrelations between the DFT and the z transform. 
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Eq. (7.11) 
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x(nT ) 



Eq. (7.3) 



x(nT) 



Figure 7.7 Time-domain aliasing. 
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processed by employing the FFT algorithms to be described in Sec. 7.11 provided that a sufficiently 
large value of N is chosen. 


7.5.2 Time-Domain Aliasing 

If 


x(jiT) ^ 0 for n < 0 or n > N 

then parts of one or more of the shifted signal copies x{nT ±NT),x(nT ±2 NT),... inEq. (7.3) will 
contribute to the value of x(nT) in the range 0 < t < NT thereby causing so-called time-domain 
aliasing which is analogous to the frequency-domain aliasing encountered in Sec. 6.7. Consequently, 
x(nT ) will not be a periodic continuation of x{nT), as illustrated in Fig. 7.7. Nevertheless, the peri¬ 
odic signal x(h T) and its DFT X( jkQ) can again be obtained from the nonperiodic signal x(n T) and 
its z transform X 0 (z), respectively, by using Eqs. (7.3) and (7.4), as illustrated in Fig. 7.7. However, 
in such a case, x(nT) cannot be recovered from x(nT) by using Eq. (7.10), because of the signal 
distortion introduced by time-domain aliasing, and so Eq. (7.11) will not yield the z transform of 
x(nT). Under these circumstances, the DFT of x(nT) is at best a distorted representation for x(nT). 


7.6 INTERRELATION BETWEEN THE DFT AND THE CFT 

The frequency spectrum of a nonperiodic discrete-time signal x(n T ) is related to that of the underlying 
continuous-time signal x(t), as was shown in Sec. 6.5.2. On the other hand, given a finite-duration 
discrete-time signal x(iiT), a corresponding periodic discrete-time signal x(nT) can be generated by 
using Eq. (7.3), which has a DFT. Consequently, a direct interrelation exists between the DFT of x(n T) 
and the CFT [5] of x(t). This can be readily established by using the results of Secs. 6.5.2 and 7.5. 

Let X(jco) and X(jco) be the CFTs of x(t) and x(t), respectively, where x(t) is the impulse- 
modulated version of x{t). From Eqs. (7.4) and (6.45a), we have 

1 OO 

X(jkQ) = X D (e ikQ - T ) = X(jkQ) = - X(jk£2 + jrw s ) (7.12a) 

r——oo 

and, therefore, from Eqs. (7.3) and (7.12a) 

V Y, *( nT + rNT ) = - Y + J™’) ( ? - 12b ) 

r =—oo r=—o o 

Now if 

x(t) = 0 for t < 0 and t > NT (7.13) 


and 


X(joj) = 0 for M > 


(7.14) 
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Figure 7.8 Interrelations between the DFT and the CFT. 
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or (6.45b) 
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the left- and right-hand summations in Eq. (7.12b) become periodic continuations of x(nT) and 
X( j(o), respectively, and as a result 

x(nT) = x(nT ) for 0 < nT <(N - 1 )T 

X{jkQ.) = ^X(jkCl) for ]&£2| < y 

Hence the periodic signal x(nT) and its DFT X(jkQ) can be obtained from the continuous-time 
signal xit) and its CFT Xijco), respectively, and conversely, as depicted in Fig. 7.8. That is, a 
continuous-time signal x(t) can be represented by a DFT and, accordingly, it can be processed by 
using the FFT method. 

7.6.1 Time-Domain Aliasing 

If Eq. (7.13) is violated, then parts of one or more of the shifted signal copies x(t±NT), x(t ±2NT), 
... will contribute to the value ofjr(f) in the range 0 < t < NT thereby causing time-domain aliasing 
and, as in the case of discrete-time signals described inSec. 7.5.2, xit) cannot be recovered from xit). 
On the other hand, if the spectrum of x(t ) does not satisfy the bandlimiting condition in Eq. (7.14), 
then X(ja)) cannot be recovered from the DFT of xit ). 


7.7 INTERRELATION BETWEEN THE DFT 
AND THE FOURIER SERIES 

The results of the previous section lead directly to a relationship between the DFT and the Fourier 
series [5]. 

A periodic signal x(t) with a period r 0 can be expressed as 


OO 

x(t) = ^2 + rr °) 

r=—o o 


(7.15) 


where x(t) = 0 for t <0 and t > to 1 . Alternatively, by using the Fourier series (see Eqs. (2.3) and 
(2.5)), we have 


OO 

x(t)= X k e jkm ' 

k=—o o 


where &>o = 2 jt /tq and 


X k 


i r T ° 

— / x(t) e - jkmt dt 
*0 Jo 


l Note that x(t) is defined to be zero for t < — tq/2 and t > tq/ 2 in Chap. 2 but the two definitions are equivalent. 
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Now with t = nT and to = NT , Eq. (7.15) becomes 


oo 

x(nT) = E x(nT + rNT) 

r=—oo 


and, consequently, Eq. (7.12a) yields 


j 

X{jkQ.)=— Y X(jkQ + jrm s ) 

r =—oo 


(7.16) 


where 


X(jk£l) = Tx(f) 


co=kQ 



x(t)e jkQ, dt 


or 


x(jka) = 


x(t)e~ ikm, dt 


Jo 

since £2 = co s /N = 2 tt/NT — 2tx/xq = coq. Evidently 

X(jkQ) = r 0 X k 

and since tg = NT, Eq. (7.16) can be put in the form 


| LaJ 

x(jka> = - E X[j(k + rN)Q] = N E Xk+rN 

r=—o o r=—oo 


(7.17) 


In effect, the DFT of x(nT) can be expressed in terms of the Fourier-series coefficients of x(t). 
Now with 


X k 0 for \k\ > — 


Eq. (7.17) gives 


X(jktl) « NX k 

for |fc| < 

1 - 


Xk » -X(jkQ) 

for \k\ < 


Thus the Fourier-series coefficients of x{t) can be efficiently computed by using the FFT method. 
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7.8 WINDOW TECHNIQUE 

As was demonstrated in Secs. 7.5 and 7.6, in order to process a discrete- or continuous-time signal, 
say, x(nT ) or x(t), through the FFT method, a corresponding periodic discrete-time signal 


OO 


x(nT) = x(nT + rT) 


r——oo 


must first be generated through periodic continuation. If x(nT) ^ Oor x(t) ^ 0 outside the time range 
0 to (N — l)T, then time-domain aliasing will be introduced, as was shown in Secs. 7.5.2 and 7.6.1, 
which will distort the signal over the period 0 to (N — \)T. The effects of time-domain aliasing can 
be reduced by forcing the signal to become zero outside the time range 0 to (TV — 1 )T in such a way 
so as to as far as possible preserve the signal’s frequency spectrum. This can be done through the 
use of the so-called window technique. 

The window technique entails the use of a class of functions known collectively as window 
functions (or simply as windows ) [6, 7], The underlying windows are continuous-time functions but 
they are usually applied in their nonperiodic or periodic discrete-time form. Discrete-time windows 
inherit their characteristics from their continuous-time counterparts. Consequently, it is worthwhile 
to study the basic principles associated with continuous-time windows before we proceed to the 
properties and application of discrete-time windows. For the sake of simplicity, we consider the 
case of two-sided windows that are defined over the range — oo < t < oo but the principles involved 
are also valid for right-sided windows that are defined over the range 0 < t < oo. 

7.8.1 Continuous-Time Windows 

Two-sided window functions share two fundamental properties: 

1. They are defined to be zero outside some interval — r < t < r, that is, 



for — r < t < x 
otherwise 


where u>o(t ) is normally an even function of t. 

2. Their spectral energy 2 is concentrated in a narrow frequency range —co m < co < a> m and is zero 
outside this range. 

The most basic window is the rectangular window which is defined as 



for — r < t < x 
otherwise 


(7.18) 


2 The spectral energy of a signal with respect to a range of frequencies o)\ to a >2 is proportional to the integral of the 
square of the amplitude spectrum of the signal over the given frequency range. 
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0 - 1 - 1 - 1 -- 1 - 1 - 1 - 

-2.0 -1.5 -1.0 -0.5 0 0.5 1.0 1.5 2.0 


co, rad/s 

Figure 7.9 Spectrum of rectangular window (r = 15.0 s). 

The frequency spectrum of the rectangular window is given by the Fourier transform of the pulse 
function p T (t) (see Table 6.2) as 


W R U(o) = 


2 sin cor 
co 


(7.19) 


and is illustrated in Fig. 7.9. 

Windows are characterized by their main-lobe width B ML , which is the bandwidth between 
the first negative and the first positive zero crossings, and by their ripple ratio r which is defined as 

r = 100— % or R = 20log dB 
Aml Aml 

where A max and Aml are the maximum side-lobe and main-lobe amplitudes, respectively (see 
Fig. 7.9). 

From Eq. (7.19), we note that the frequency spectrum of the rectangular window has zero 
crossings when cor — ±/«tt for m = 1, 2,... and hence Bml = 2n/r. On the other hand, the ripple 
ratio can be plotted as a function of r as shown in Fig. 7.10. Evidently, the ripple ratio assumes a 
value of about —13.26 dB which is practically independent of the window length r. This is a fairly 
large ripple ratio which tends to limit the usefulness of the rectangular window. 

The window technique entails multiplying the signal to be processed by the window function, 

i.e., 


x w (t) = w(t)x(t) 
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Figure 7.10 Ripple ratio of rectangular window versus window length r. 

In order to examine the effect of a window on the frequency spectrum of a signal, consider a signal 
that has a uniform real spectrum over the frequency range — co c < to < —co c , that is, 

X(jM) = ( ‘ t0rM<< "' 

10 otherwise 

as shown in Fig. 7.11a and assume that the spectrum of w(t) is concentrated in the range — to,,, < 
to < co m and is zero outside this range, i.e., 


w W ={;° M 


for | a; | < co m 
otherwise 


where Wq{co) is an even real function of to as depicted in Fig. 1 Alb. For the sake of convenience and 
without loss of generality, assume that the area under the graph of W(jco) is equal to 2n. The reason 
for this will become evident below. 

Since x w (t) is the product of two time-domain functions, the spectrum of the modified signal 
can be obtained by using the frequency convolution of the Fourier transform (Theorem 2.15) as 


Xw(ju) 


1 

2 JT 
1 

2 7T 


W(jur)X(jto — jzu)dur 

l 

X(jzu)W(jco — jm)dur 


(7.20a) 


— OO 


(7.20b) 
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x(M 







1 

CO 


-0) c <O c 

(a) 



(b) 


Figure 7.11 Frequency spectrums of x(t) and w(t). 


Using Eq. (7.20b), the spectrum of x w {t) at some arbitrary frequency co can be obtained through the 
following graphical construction: 

1. Replace the frequency variable co in X(joo) and W(jco) by variable tjj to obtain X(juj) and 
W(jm), respectively, as shown in Fig. 7.12a and b. 

2. Replace m in W(jm) by — m in Fig. 7.12h, that is, turn over the spectrum of w(t) end-to-end 
with respect to the m axis, to obtain W(—jm). This step would have no effect in the present 
application because the spectrum of the window has been assumed to be an even function of co 
and it is, therefore, symmetrical about the y axis. 

3. Shift W(—jm) to the right by co to obtain W(jco — jm) as shown in Fig. 7.12c. 

4. Form the product X(jm)W(ja> — jm) as shown in Fig. 7.12 d. 

5. Area A(jco) in Fig. 7.12c/ is given by 


Mj<»)= / X(jm)W(ja) - jm)dm 


andfromEq. (7.20b) we note that X w (jco) = A(jco)/2it. Since the area under the graph W(jm) 
has been assumed to be equal to 2 it, A(jco) would be equal to 2tc in the frequency range 0 to 
co c — co m and a fraction of that amount in the range co c — co m to co c + co m . In effect, X w (j co) would 
assume the value of unity for frequencies in the range 0 to co c — oo,„ and a fraction between 1 
and 0 in the range co c — co m to co c + co m . 









THE DISCRETE FOURIER TRANSFORM 341 


'm) 









m 


(x) c 0)c 


I 


W(jm) 


(a) 

I 


2 tt I 


K 


0) m COm 


(b) 


m 


W(jco-jm) 


I 

I 

I 

I 

I 



m 


(c) 


X(jzn) W(jaj-jm) 


i 

l 

l 

l 

l 

l 



co 


(d) 


m 


Figure 7.12 Evaluation of convolution integral. 


If co is varied in the range o>\ to 005 through the point of discontinuity co = co c , the above 
graphical construction will give Fig. 7.13c to / and by multiplying each of the areas A(jo >\), 
A(ja> 2 ),■. .by the factor 1/2 tt, the frequency spectrum of the modified signal can be obtained as 
illustrated in Fig. 7.13g. Since the areas A(ja >\). A(ja> 2 ),... assume values in the range 2n to 0, 
it follows that X w (ja)) will assume values in the range 1 to 0. As can be seen in Fig. 7.13g, the 
spectrum of the modified signal is the same as that of the original signal except that a transition band 
has been introduced at the point of discontinuity 00 = co c . The same would also happen at any other 
discontinuity. 

From Fig. 7.13g, we observe that the width of the transition band introduced is equal to 2 co m , 
which is the main-lobe width of the window. Therefore, the main-lobe width should, in practice, be 
as small as possible. 

The window considered in the above demonstration is actually an idealization. In practice, the 
window has side lobes and, therefore, the spectral energy outside the main lobe is never zero. If an 













342 DIGITAL SIGNAL PROCESSING 



(a) 


(b) 


(C) 


(d) 


(e) 


(/) 


0 ?) 


Figure 7.13 Effect of an idealized window on the spectrum of a signal. 


actual window were to be used in the graphical construction of Fig. 7.13, as illustrated in Fig. 7.14, 
then the areas under the graphs in Fig. 7A4d and e, namely, A(ja> o) and A{ju>o), respectively, would 
be slightly different from 2tc in the first case and from zero in the second case due to the area of the 
side lobes. Similarly, the spectrum of x w (t ) would be slightly different from unity and 0 at frequencies 
g)q and &>6, respectively, as shown in Fig. 7.14/. Now as o> is varied, the area of the side ripples that 
happen to fall in the range 0 < cd < co c will vary and, consequently, the spectrum of the modified 
signal will exhibit oscillations whose amplitude would be directly related to the amplitude of the 
window side ripples. We conclude, therefore, that the amplitude of side lobes should, in practice, be 
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Figure 7.14 Effect of window side lobes. 


as small as possible in relation to the amplitude of the main lobe, i.e., the ripple ratio should be as 
small as possible. 


Example 7.2 


The infinite-duration signal 


sinovr 

x(t) = - - 

IT t 

where co c = 1 rad/s, is to be converted into a corresponding finite-duration signal x w (t) by 
using the rectangular window defined in Eq. (7.18) with r = 15.0 s. (a) Obtain X(ja>), the 
frequency spectrum of x(t). (b) Repeat part (a) for the modified signal x w (t). (c) Plot the 
difference between X(ja)) and X w (jco). 
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i Solution 

(a) From Table 6.2, we have 


X(jco) = P2io c (u) 


(7.21) 


where 


P2w c ((o) 


tor \co\ < a> c 

otherwise 


( b ) From Eqs. (7.19), (7.20b), and (7.21), the frequency spectrum of the modified signal 
is obtained as 


X w (joj) = 


1 r 

2?r J_ r 


X(jm)W R (jco - jm)dm 


1 

7T 


sin(tt) — m)x 

P2 o>A m > - dm 


1 

TC 


sin(tt) — nr) x 


dm 


(7.22) 


The real integral in Eq. (7.22) can be evaluated by means of some numerical formula, 
for example, Simpson’s one-third rule (see p. 381 of Ref. [11]) given by 


f{x) dx = ( yi + 4 >-, + 2 ^ y, + y m+ \ 


(7.23) 


i odd 


where m is assumed to be an even integer. 

The graphical construction for the convolution integral of Eq. (7.22)forr = 15.0s 
and a> c = 1 rad/s is illustrated in Fig. 7.15. The spectrum of x w (t), that is, X m (ja)) is 
illustrated in Fig. 7.15e. 

(c) The difference between X„.(o>) and X(o>), which is plotted in Fig. 7.15/, is seen to 
oscillate about zero and becomes significantly larger at frequencies close to the band 
edges ±(w c . The oscillations in X„ (o>) are caused by the side lobes in the spectrum of the 
window, as was anticipated earlier. The larger difference near the band edges is due to 
the finite main-lobe width and it is caused by the fact that convolution tends to smooth 
the value of the function in the region of a discontinuity. If the ripple ratio and main-lobe 
width of the window function were decreased, the spectrum of the finite-duration signal 
x w (t) would tend to approach that of the infinite-duration signal x(t). m 
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Figure 7.15 Use of rectangular window (Example 7.2): (a) Spectrum of original signal, 

( b ) shifted spectrum of window, (c) truncated spectrum of window, ( d ) area under the curve in 
plot (c), (e) modified spectrum of signal, (/) difference between the spectrums of the original 
and modified signals. 









































































346 DIGITAL SIGNAL PROCESSING 


KAISER WINDOW. For a fixed value of r, the rectangular window has a fairly narrow main lobe 
relative to that in other windows, which is an advantage because it tends to introduce narrow transition 
bands at signal discontinuities. Its main disadvantage is that it has a high ripple ratio which causes 
a large in-band error (see Fig. 7.15e). Since the main-lobe width of the rectangular window is given 
by B w = 2n /r, it can be controlled by choosing parameter r but as was found out, the ripple ratio 
of the rectangular window is practically independent of r and cannot be controlled (see Fig. 7.10). 
The alternative is to use more sophisticated windows, such as the Kaiser and Dolph-Chebyshev 
windows [6, 8] which offer two degrees of freedom, namely, r and some other parameter. An even 
more advanced window is the so-called ultraspherical window [9, 10] which offers three degrees of 
freedom, namely, r and two other parameters. In these parametric windows the available degrees of 
freedom can be used to adjust the main-lobe width and/or the ripple ratio. An important feature 
of known windows is that the main-lobe width is always inversely proportional to the window 
length r. 

The Kaiser window is a fairly flexible and easy to compute window and it is, therefore, used 
widely. It is given by 


w K (t) = 


W) 
Io (a) 
0 


for — r < t < r 
otherwise 


(7.24) 


where a is an independent parameter and 


/3 = a 




(7.25) 


Function Iq(x) is the zeroth-order modified Bessel function of the first kind? It can be computed to 
any degree of precision by using the rapidly converging series 


h(x) = i+y^ 


k= 1 L 


\ 1 ( 

X\k~ 

k\ v 

2/ 


The frequency spectrum of the Kaiser window is given by [6] 


W K (j(o) = 


2 sin (tV« 2 - 
7o( a ) \J ofi — cOq 


(7.26) 


(7.27) 


where co a — a /r. The Kaiser window and its frequency spectrum are plotted in Fig. 7.16a and h for 
r = 15.0 s. 

Using Eq. (7.27), the ripple ratio and main-lobe width of the Kaiser window can be plotted as 
functions of a as depicted in Fig. 7.17a and b. The ripple ratio decreases rapidly as a is increased but 
it is practically independent of the window length. On the other hand, the main-lobe width increases 


3 Function besseli(0,x) in MATLAB. 
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(b) 

Figure 7.16 Kaiser window (a = 3.0, r = 15.0 s): (a) Time domain, (b) frequency domain. 

with increasing values of a but, as in other windows, it is inversely proportional to the window 
length. 


Example 7.3 


(a) Solve the problem of Example 7.2 using the Kaiser window with a = 3.0 
and r = 15.0 s and compare the results with those obtained with the rectangular window in 
Example 7.2. ( b ) Repeat for r — 63.0 s. 


■ Solution 

(a) For this example, 

1 f°° 

X w (jco) = — / X(jm)W K (joj - jm)dm 
J —oo 

where X(ja >) and Wxijco) are given by Eqs. (7.21) and (7.27), respectively. Evaluating 
the above integral with a = 3.0 and r = 15.0 s using the formula in Eq. (7.23), as in 
Example 7.2, the frequency spectrum of x w (t ) shown in Fig. 7.18a can be obtained. The 
difference between the spectrums of x(t ) and x w (t) is plotted in Fig. 7.18£>. ■ 

(b) The spectrum of. x w {t) fora = 3.0 and r = 63.0 s is obtained, as shown in Fig. 7.18c, 
as in part (a). The difference between the spectrums of x(t) and x w (t) is plotted in 
Fig. 7.18r/. 
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(a) 



(b) 

Figure 7.17 Characteristics of Kaiser window : (a) Ripple ratio in dB versus a for t = 21 s, 
(, b ) main-lobe width versus a for different window lengths. 


A comparison of Fig. 7.1 5e and 7.18a shows that the rectangular window offers nar¬ 
rower transition bands whereas the Kaiser window offers a reduced ripple amplitude. By 
increasing r in the Kaiser window, which amounts to reducing the main-lobe width, the 
width of the transition bands can be reduced, as can be seen by comparing Fig. 7.18a and c, 
while maintaining a reduced ripple amplitude. ■ 
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Figure 7.18 Use of Kaiser window (Example 7.3): (a) Spectrum of modified signal for 
a = 3.0 and r = 15.0 s, ( b ) difference between the spectrums of the original and modified 
signals, (c) spectrum of modified signal for a = 3.0 and r = 63.0 s, (d) difference between the 
spectrums of the original and modified signals. 
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7.8.2 Discrete-Time Windows 

Given a continuous-time window, two corresponding discrete-time windows can be derived, namely, 
odd- and even-length windows. These are obtained by sampling the continuous-time window function 
at nT — 0, ±T, ±2T, ..., ±(N W — 1 )T /2 for an odd-length window or at nT — ±\T, ±| T, ..., 
± (N w — \)T/2 for an even-length window. Typically an odd window length is preferred although 
even-length windows are sometimes required for certain specialized applications (see, for example. 
Sec. 18.4.1). 

A rectangular discrete-time window of odd length can be readily obtained by letting t — nT 
and r = [{N w — l)T]/2 in Eq. (7.18), that is, 


w R (nT) = 


for ~[(N W - \)T]/2 < nT < [{N w - 1)71/2 
otherwise 


Its z transform is given by 


(N w -l)/2 

W R {z) = Y, z ~ n 

n=—(N w —l)/2 


and since the above sum is a geometric series, a closed-form expression can be obtained as 

V (N W - 1)/2 _ -(W„+l)/2 

W R (z) = - - - -^- 

1 - Z _1 

Z NJ2 _ Z -NJ2 

Z ! /2 — Z — 

By evaluating the z transform on the unit circle, the frequency spectrum of the rectangular window 
can be obtained as 


W R (e^ T ) = 


e jcoN w T/2 _ e -ja>N w T/2 
e ja>T/2 _ g-jioT/2 


sin (coN w T / 2) 

sin(tt)r/2) 


Similarly, a Kaiser discrete-time window of odd length can be derived from Eqs. (7.24) and 
(7.25) as 


w K (nT) = 


W) 
h (a) 
0 


for ~(N W - \)T/2 < nT < (N w - l)T/2 
otherwise 


(7.28) 


where a is an independent parameter and 


/3 = a 



2 n 


N,„ - 1 


2 


(7.29) 
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(see Prob. 7.13, part ( a )). The z transform of w K (nT) is given by 

av„-i)/2 

W K (z) = Y w K(nT)z~ n 

n=-(N w - 1)/2 

and hence the frequency spectrum of the Kaiser window can be obtained as 

(At„-l)/2 

W K (e jo>T ) = Y WK(nT)e- jcoT 

n=—(N w —l)/2 

An approximate but closed-form expression for the spectrum of the discrete-time Kaiser win¬ 
dow can be deduced by noting that the spectral energy of the continuous-time Kaiser window is 
concentrated at low frequencies (see Fig. 7.16 b) and, therefore, for a sufficiently large sampling 
frequency co s , we have 


W K (j(o) & 0 for \co\ > y (7.30) 

Consequently, the spectrum of impulse-modulated signal u>k{i) and, equivalently, the spectrum of 
wxinT) can be expressed as 


W K (jco) = W K (e jaT ) » -Wk(joj) 


for 0 < \w\ < — 

_ii 2 


(7.31) 


according to Eq. (6.45a). Hence Eqs. (7.27), (7.30), and (7.31) give 


W K {e iaT ) 


N,r 


sin 


ay/(a>/a> a ) 2 - 1 


a7 0 (a) yj(m/(0a) 2 ~ 1 


(7.32) 


where 


co a 


2a 

(N w - 1 )T 


(see Prob. 7.13, part (/?)). The application of the window technique to discrete-time signals involves 
the same steps as in the continuous-time case although some subtle differences should be noted for 
its successful application. The modified discrete-time signal is obtained by multiplying the signal by 
a suitable discrete-time window, i.e., 

x w (nT) = w(nT)x(nT ) 


The frequency spectrum of the modified signal x w (nT) can be obtained by finding the z 
transform of x w (nT) and then evaluating it on the unit circle. Since the z transform of a product of 
discrete-time functions can be obtained by using the complex-convolution theorem (Theorem 3.10), 
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we can write 

Zx w (nT) = X w {z) = - (j X(v)W (-) u -1 dv (7.33a) 

2nj J r \vJ 

X W(v)v~ l dv (7.33b) 

where X(z) is the z transform of x(nT) and I' represents a contour in the common region of conver¬ 

gence of X(v) and W(z/v). With 

v = e jmT and z = e jwT 

and X(v) as well as W(z/v) convergent on the unit circle of the v plane, Eqs. (7.33a) and (7.33b) 
give the frequency spectrum of x w (t) as 



T 

r2x/T 


2 7t . 

/ X{e ]mT )W{e j( ‘°- m)T ) dm 

Jo 

(7.34a) 

T 

f2n/T 


2tx , 

/ X(e j(c °- m)T )W(e jmT )dm 

(7.34b) 

Jo 


These formulas are essentially convolution integrals of the type given by Eqs. (7.20a) and (7.20b) 
except that the integration is carried out over the finite frequency range 0 < m < 2ic/T. Thus the ef¬ 
fects of a discrete-time window on a discrete-time signal are entirely analogous to those encountered 
in the continuous-time case. The side lobes of the window function tend to introduce oscillations 
in the amplitude spectrum of the signal whose amplitude tends to decrease as the ripple ratio of 
the window is decreased. The main-lobe width tends to even out abrupt changes in the amplitude 
spectrum and, as a consequence, it tends to introduce transition bands at discontinuities. To minimize 
this effect, the main-lobe width should be as small as possible. As in the continuous-time case, the 
main-lobe width can be reduced by increasing the length of the window. 


7.8.3 Periodic Discrete-Time Windows 

The application of the window technique to periodic discrete-time signals involves one more wrinkle. 
Since the values of a periodic signal x(nT ) are normally defined at 0, 7'. ... , (N — 1 )T and N is 
usually a power of 2, to facilitate the application of the FFT method N must be even. As may be 
recalled from Sec. 7.8.2, the values of a window of odd-length N w occur at 0, ±7’,... , ±(N W — l)/2 
whereas those of an even-length window occur at ±T/2, ±3 T /2, ... , ±(N W — l)/2. Consequently, 
a window of odd length is easier to apply. Therefore, the window length N w should not exceed N — 1. 

A periodic window u>(nT ) with a period NT can be readily obtained from a nonperiodic win¬ 
dow winT) through periodic continuation whereby shifted copies of w(nT), namely, w(nT +rNT) 
for..., —2, — 1, 0,1,2,... are added up according to Eq. (7.3). Now the DFT is normally computed 
with respect to the period 0 to (N — 1 )T whereas nonperiodic windows of odd length N w are defined 
with respect to the period — [(An, — l)T]/2 to [(/V,,, — 1 )7’]/2. This discrepancy can be easily cir¬ 
cumvented by constructing a right-sided discrete-time window before converting it into a periodic 
window through periodic continuation. For example, a right-side discrete-time Kaiser window can 
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be readily obtained as 


w K (nT) = w K [nT ~(N w -l)T/2] (7.35a) 

and a corresponding periodic version can be constructed as 

OO 

w K (nT)= WidnT + rNT) (7.35b) 

r=—o o 

as illustrated in Fig. 7.1%. An alternative but equivalent possibility would be to apply periodic 
continuation to the two-sided window as 


w(nT) = 


w K (0) 

for n = 0 



w K (nT) 

for 1 < n < ( N w — l)/2 



0 

for [(N w — l)/2 + 1] < n 

< [N - 

- (N w + l)/2] 

w K [(n-N)T] 

for [N - (N w - 11/2] < n 

< (N - 

- 1) 


(7.35c) 


This possibility is illustrated in Fig. 7.19c. 





Figure 7.19 Generation of a periodic window function: (a) Nonperiodic window, (b) periodic window of 
Eq. (7.35b), (c) periodic window of Eq. (7.35c). 
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Example 7.4 


(a) Obtain a periodic Kaiser window of length 13 for a 16-point DFT using 
Eq. (7.35b). ( b ) Repeat part (a) using Eq. (7.35c). 


■ Solution 

From Eqs. (7.35b) and (7.35c), the values shown in columns 2 and 3 of Table 7.1 
can be obtained. The numerical values of the Kaiser window can be calculated using 
Eqs. (7.28) and (7.29) where 7 q(x) is given by Eq. (7.26). ■ 


Table 7.1 Values of periodic Kaiser window 
of length 13 (Example 7.4) 


wk(hT) 

Eq. (7.35b) 

Eq. (7.35c) 

w K (0) 

w k (~6T ) 

w K (0) 

w k (T) 

w k (~5T) 

w k (T ) 

wk(2T) 

w k (-4T) 

w k (2T) 

wkOT) 

w k (~3T) 

w k QT) 

wk(4T) 

w k (~2T) 

w k (4T) 

w K (5T) 

w k (-T) 

w k (5T) 

w k (6T) 

w k (0) 

w k (6T) 

wkOT) 

w k (T) 

0 

w k (8T) 

w k (2T) 

0 

w k (9T) 

w k QT) 

0 

w k (10T) 

w k (4T) 

w k (-6T) 

w k (\\T) 

w k (5T) 

w k (-5T) 

*jc(12 T) 

w k (6T) 

w k (~4T) 

Wk(13T) 

0 

w k (-2T) 

Wk(14T) 

0 

w k (~2T) 

w k (15T) 

0 

w k (~T ) 


7.8.4 Application of Window Technique 

The window technique can be applied to continuous- and discrete-time nonperiodic or periodic sig¬ 
nals. If the signal to be processed is a nonperiodic continuous-time signal, then it must be subjected 
to three processes before it can be processed, namely, sampling, windowing, and periodic continua¬ 
tion. Depending on the order of these operations, three options are available to us, namely, to apply 
windowing to the continuous-time signal, to the discrete-time signal, or to the periodic discrete-time 
signal. The three possibilities are, of course, equivalent but the first is the easiest to explain. 

A given continuous-time signal x(t) of arbitrary length with a frequency spectrum X(ja >) can 
be forced to assume zero values outside the range 0 < t < N w T through windowing such that 

x w {t) = 0 for t < 0 and t > N W T (7.36) 

as illustrated in Fig. 7.20c. By choosing a window with sufficiently small main-lobe width and ripple 
ratio, the spectrum of the modified signal can be made to approach the spectrum of the original signal 
so that X w (ja >) X(jca) as shown in Fig. 7.20c. 










355 



Figure 7.20 The use of window functions. 
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If the frequency spectrum of x w (t), is bandlimited and a sufficiently high sampling frequency 
a> s is used, we have 


X w un)xi0 for |£2| >y 
in which case Eq. (7.12b) would assume the form 


(7.37) 


OO J oo 

2? ^2 x w (nT + rNT) « — ^ X w (jkQ. + jrco s ) 

r=—o o r=—o o 

as illustrated in Fig. 7.20 cl. Unfortunately, the frequency spectrum of the signal is usually not known 
a priori and, therefore, the sampling frequency that would satisfy Eq. (7.37) is also not known. 
One way of estimating the correct sampling frequency would be to compute the DFT of x w (nT ) 
for progressively larger sampling frequencies (smaller sampling periods) until two successive DFT 
evaluations yield approximately the same DFT values. When that happens, the reduction in aliasing 
brought about by the last sampling frequency can be deemed to be negligible and the last but one 
sampling frequency can be taken to be the lowest acceptable sampling frequency for the application 
at hand. One possibility would be to start with some low sampling frequency, say co s , and then carry 
out DFT evaluations for sampling frequencies 2 u> s , 4co s ,.... Since the sampling frequency for each 
new DFT evaluation is twice the previous value, the number of points N must also be doubled to 
maintain a constant resolution for the DFT, i.e., Q = o> s /N. This technique is illustrated by the 
following example. 


Example 7.5 


An infinite-duration right-sided discrete-time signal x(nT) is obtained by 
sampling the continuous-time signal 


x(t ) = u(t) [Aoe Pof + 2M\e ait cos(o>if + 0i)] 


where Aq = 4.532, M\ = 2.350, B\ = —2.873 rad, po = —2.322, <j\ = —1.839, and 
u>\ = 1.754 rad/s. A finite duration signal can be obtained by applying the discrete-time 
Kaiser window with a — 1.0. Using the above technique, find the lowest sampling frequency 
(largest sampling period) that would result in negligible aliasing. 


■ Solution 

A problem of this type can be solved by obtaining the DFT of the signal for several 
increasing sampling frequencies until two successive DFTs differ from one another by 
an error that is considered acceptable for the application at hand. The last DFT can be 
deemed to be free of aliasing and the sampling frequency used in the last evaluation can 
be taken to be the required one. 
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Table 7.2 Values of N, T, and uj s 
for Example 7.5 


N 

T, s 

cd v , rad/s 

16 

1.6 

3.9264 

32 

0.8 

7.8528 

64 

0.4 

15.7056 

128 

0.2 

31.4112 


In order to be able to compare successive DFTs of the same signal, it is important to keep 
the discrete-frequency parameter Q fixed. From the definition of the DFT in Sec. 7.2, 
we have 

„ co s 2 7T 

n = — = — 

N NT 

and by selecting the values of N and T shown in Table 7.2, a constant value of £2 equal 
to 0.2454 rad/s can be achieved. The corresponding values of co s for N = 16, 32, 64, 
and 128 are given by the product NO. and are listed in column 3 of Table 7.2. 

A periodic Kaiser window function can be constructed as 

OO 

w(nT ) = w(nT + NT) 

r=—oo 

where 

w(nT) = Wx(nT) for — (N — 2)/2 < n < (N — 2)/2 

is a nonperiodic window function of odd length. Assuming a window length N w = N — 1, 
Eq. (7.35b) gives 

uiicinT) for 0 < n < (N — 2)/2 

0 for n = N / 2 

w K [(n — N)] for (N + 2)/2 < n < (N — 1) 

The values of wg(nT) can be determined by using Eqs. (7.28) and (7.29) where Iq(x) is 
given by Eq. (7.26). 

On obtaining the DFT of x w (nT) for the four sets of parameters shown in Table 7.2, 
the results plotted in Fig. 7.21 can be obtained. As can be seen, the difference be¬ 
tween the DFTs for the last and last-but-one cases is barely noticeable and we conclude, 
therefore, that the use of the sampling frequency 15.7056 rad/s would entail negligible 
aliasing. ■ 


ib(nT ) = 
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Figure 7.21 Amplitude spectrum of x(t ) for different sampling frequencies (Example 7.5). 


Discrete-time windows are also used in the design of FIR digital filters and a good collection 
of such functions, including the Dolph-Chebyshev window, can be found in Sec. 9.4. 


7.9 SIMPLIFIED NOTATION 

The preceding somewhat complicated notation for the DFT was adopted in order to eliminate possible 
confusion between the various transforms. As we shall be dealing exclusively with the DFT for the 
rest of this chapter, we can write 


where 


N-\ i N— 1 

X(k) = Y x(n)W~ kn x(n) = — Y X(k)W kn 


n=0 


k=0 


x(n) = x(nT) X(k) = X(jk£2) 


i.e., x(n) and X(k) are implicitly assumed to be periodic. Furthermore, signals and their frequency 
spectrums are deemed to be normalized with respect to time and frequency whereby the discrete time 
and frequency variables T and Q are assumed to be 1 s and 2:t/N rad/s, respectively (see Sec. 1.4). 


7.10 PERIODIC CONVOLUTIONS 

The convolutions of the CFT and the z transform find numerous applications in signal processing. 
Analogous and equally useful convolutions exist for the DFT. These are usually referred to as periodic 
or cyclic convolutions. 
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7.10.1 Time-Domain Periodic Convolution 

The time-domain convolution of two periodic signals x(n) and h(n), each with period N, is defined 
as 


N -1 

y(n) = x{m)h(n — m) 

m =0 
N -1 

= x{n — m)h(m) 

m =0 


(7.38a) 

(7.38b) 


Like a'(u) or /i(n), y(n) is a periodic function of n with period N. 

The periodic time-domain convolution can be illustrated by a graphical construction which is 
very similar to that used for the convolution summation described in Sec. 4.6.1; the main difference 
being the periodicity of the signals involved in the present convolution. The time-domain convolution 
is illustrated by the following example. 


Example 7.6 


Each of the signals 


and 


x(n) = e~ an for 0 < n < 9 



for 3 < n < 6 
for 0 < n < 2 
for 7 < n < 9 


is periodic with period IV = 10. Find the periodic convolution of the two signals at n = 5. 


■ Solution 

A graphical construction for the time-domain convolution can be obtained as follows: 

1. Replace variable n by m in both h(n ) and x(n) to obtain x(m) and h(m). 

2. Turn signal x(m) over end-to-end to obtain x(—m ). 

3. Shift x(—m) to the right by 5 s as shown in Fig. 7.22 a which can be drawn as shown 
in Fig. 1.22b. 

4. Noting the periodicity of x(m), construct the equivalent graph shown in Fig. 7.22c. 

5. Form all the possible products h(m)x(5 — m) in Fig. 7.22c. 

6. Add all the nonzero products in Fig. 7.22c to obtain the time-convolution. 

From Fig. 7.22c, we have 

y(5) =l + e- a + e~ 2a + e~ 9 “ 
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h(m) 
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(c) 

Figure 7.22 Time-domain, periodic convolution (Example 7.6). 

Alternatively, from the time-domain convolution of Eq. (7.38b), we have 

y(k) = x(k)h(0) + x(k — 1 )/z (1) + ■ ■ ■ + x(k)h(0) + x{k + l)/z(— 1) 
+ • • • + x(k — N + 1 )h(N — 1) 
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Hence 

y( 5) = x(5)h(0) + x(4)h(\) + x(3)h(2) + x(2)h(3) + x(l)/z(4) 
+/z(5)x(0) + h( 6)x(-l) + /z(7)x(— 2) + h( 8)x(-3) 

+h( 9)x(-4) 

= x(5)/j(0) + x(4)/j(1) + x(3)/j( 2) + x(2)/i(3) + x(l)/i(4) 
+x(0)/z(5) + x(9)/i(6) + x(8)/i(7) + x(7)/i(8) + x(6)/i(9) 
= x(2)/i(3) + x(1)/j( 4) + x(0)/i(5) + x(9)h(6) 

= x(0) + x(l) + x(2) + x(9) 

= 1 + e~“ + e~ la + e- 9ff ■ 


Theorem 7.2/1 Time-Domain Periodic Convolution If h(n ) and x(n) are two periodic 
discrete-time functions, each with period N, with DFTs H(k) and X(k), respectively, then the 
DFT of the time-domain convolution of h(n) and x(n) is given by 

Y(k) = IKk)X(k) 

Proof The DFT of y(n) can be obtained from the definition in Sec. 7.2 as 


N -1 


nk) = 

n =0 


~N-l 

h(m)x(n — m) 

_m= 0 


w~ kn 


N- 1 N -1 

= Y h(m)W~ km Y *(« “ m)W~ k(n - m) 

m=0 ii—O 


N-\ N -1 

= ^ h(n)W~ kn Y x W w ~ k " 

ii—O n=0 


and, therefore, 


Y(k) = H(k)X(k) A 


(7.39) 


7.10.2 Frequency-Domain Periodic Convolution 

The frequency-domain convolution of two DFTs H(k) and X(k) is defined as 


Y(k) = 


1 

N 


N -1 

Y^ X(m)H(k — m) 

m= 0 


l 

N 


N -1 

Y^ X(k — m)H(m) 

m—0 


(7.40a) 


(7.40b) 






362 


DIGITAL SIGNAL PROCESSING 


Theorem 7.2ft Frequency-Domain Periodic Convolution The IDFT of the frequency- 
domain periodic convolution of FI (k) and X(k) is given by 

y(n) = h(n)x(n) ▲ (7.41) 

The proof is left as an exercise (see Prob. 7.23). 


7.11 FAST FOURIER-TRANSFORM ALGORITHMS 

The direct evaluation of the DFT involves N complex multiplications and N — 1 complex additions 
for each value of X(k), and since there are N values to determine, N 2 multiplications and N(N — 1) 
additions are necessary. Consequently, for large values of N, say in excess of 1000, direct evaluation 
involves a considerable amount of computation. 

It turns out that the direct evaluation of the DFT on the basis of its definition entails a large 
amount of redundancy and through some clever strategies, a huge reduction in the amount of compu¬ 
tation can be achieved. These strategies have come to be known collectively as fast Fourier transforms 
(FFTs) although, to be precise, these methods have nothing to do with transforms in the true sense 
of the word. 

We describe here two FFTs, the so-called decimation-in-time and decimation-in-frequency 
algorithms. 

7.11.1 Decimation-in-Time Algorithm 

Let the desired DFT be 

N -1 

X(k ) = x ( n ) W N kn where W N = e j2n/N 

n =0 


and assume that 


N — 2 r 


where r is an integer. The above summation can be split into two parts as 


N -1 N -1 

X(k) = *{n)W„ kn + x (n)Wu kn 

n =0 n =0 

n even n odd 

Alternatively 

N/ 2—1 N/ 2-1 

X(k)= * 10 (n)W^ 2kn + W„ k Y, *11 (n)Wf kn (7.42) 

n=0 n=0 


where 


xio (n) = x(2 n) 
xn(n) = x(2n + 1) 


(7.43a) 

(7.43b) 
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for 0 < n < N/2 — 1. Since 

W~ 2kn — fi -J 4knn / N — „-j 2 knir/(N/ 2 ) _ ti j-kn 

vv N — e — e — vv N /2 

Eq. (7.42) can be expressed as 


iV/2-1 JV/2-1 

X(k) = J2 * 10 + W„ k J2 xn{n)WJ$ 

n =0 72=0 


Clearly 


X(k) = X t0 (k) + W^X n (k) (7.44) 

and since Xio(£) and 2 lh(£) are periodic, each with period N/2, we have 

X ^ + f) = Zl ° (* + j) + W N k+N ' 2)X 11 (* + f 

= X l0 (k) - W^X n (k) (7.45) 

Equations (7.44) and (7.45) can be represented by the signal flow graph of Fig. 7.23 a, where 
the minus sign in ±W// k is pertinent in the computation of X(k + N/2). Since the graph looks 
very much like a butterfly, it has come to be known as a butterfly and it is often represented by the 
simplified diagram of Fig. 7.23 b for convenience. 


*io(*) 



X(k) 


Figure 7.23 (a) Butterfly flow graph, (b) simplified diagram. 
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What we have accomplished so far is to express the desired TV-element DFT as a function of two 
(/V/2)-element DFTs. Assuming that the values of X 10 (E) and X ] | (k) are available in corresponding 
arrays, the values of X{k) can be readily computed as depicted in Fig. 7.24a. 

X\o(k) and X\\(k) can now be expressed in terms of (/V/4)-element DFTs by repeating the 
above cycle of activities. For X\o(k), we can write 

N/ 2-1 

2fio(E) = Y^ x\o(n)W N ^2 

n =0 


N/4-l N/ 4-1 

= ^ x w (2n)W^ kn + Y -*io(2« + mj? n+l) 

n =0 n =0 

N/ 4—1 iV/4—1 

= Y X 2 o(n)W^ + WJj* Y * 2 iin)W$ (7.46a) 

n =0 n =0 


and, similarly, for Xn(k) 

N/2-l 

Xu(k) = Y *n(n)W$ 

n =0 

N/4-l N/4-l 

= Y xnWW*/.’ + Wn 2 " Y xxWWn/Z (7.46b) 

n =0 n=0 

where 


X 20 in) = xio(2 n) (7.47a) 

X 21 (n) = xio(2 n + 1) (7.47b) 

X 2 i(n) = xn(2n) (7.47c) 

X23(n) = xn(2n + 1) (7.47d) 


for 0 < n < A/4 — 1. Consequently, from Eqs. (7.46a) and (7.46b), we have 

*io(*) = XjoM + wf k X 2 x(k) 

X i° ^ = X M (*) - W^X 2 i(k) 

X n (k) = X 22 (k)+W^ 2k X 23 (k) 

Xu (k+^j= X 22 {k) - W^ 2k X 23 (k) 
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X 2i (k) 


*10 (*) 


X(k) 


X 20 (k) 


X 2l (k) 


X 22 (k) 


X 22 (k) 


X n (k) 



(a) 


Figure 7.24 


Decimation-in-time FFT algorithm: (a) First and second cycles. 
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Thus if the values of X 20 (k), X 2 i(k), X 22 (k), and X 2 3 (k ) are available, those of X 3 o(k) and In(f) 
and in turn those of X(k ) can be computed, as illustrated in Fig. 7.24a. 

In exactly the same way, the mth cycle of the above procedure would yield 

* (m _i)0 (*) = X m0 (k) + wf"~' k X ml (k) 

X( m -\)Q [k + ^j= X m0 (k) - w^ m ~ lk x ml (k) 

I(.-Di(f) = X m2 (k) + W^' k X m3 (k) 

X(m—l)l (k + ^ = X m2 (k) - wf"~' k x m3 (k) 


where 


Xmo(n) = x (m _i)o(2 n) 

(7.48a) 

Xml (n) = X(,„_do(2 n + 1) 

(7.48b) 

Xmlin) = X( m -i)i(2n) 

(7.48c) 

x,„3 (n) = X( m -i)\{2n + 1) 

(7.48d) 


for 0 < n < N/2 m — 1. Clearly, the procedure would terminate with the rth cycle (/V = 2 r ) since 
x r o(n), x, 1 («), ... reduce the one-element sequences, in which case 

X r ,(0) = x ri (0) for i = 0, 1,... , N - 1 

The values of the penultimate DFTs can be obtained from the above equations as 

^ (r -Do(0) = x r0 (0)+<x r i(0) 

X (r -i )0 (l) = x r0 (0) - W° N x r m 
X(r—l)l ( 0 ) = X r 2(0) + WyX r 3 ( 0 ) 

X ( r-Dl(l) = *r2(0) - W&* r3 (0) 


Assuming that the sequence {x r o(0), Jc,-i(0), ...} is available in an array, the values of X( r _iy(k) for 
i = 0,1, ... can be computed as in Fig. 1.24b. Then the values of A (r _ 2 y(k), X {r _ 3)i (k), ... can be 
computed in sequence, and ultimately the values of X(k) can be obtained. 
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x ri ( 0 ) X N #> 

40 ) 

41) 


47) 


(fc) 

Figure 7.24 Cont’d Decimation-in-time FFT algorithm: ( b ) rth cycle. 



The only remaining task at this point is to identify elements x r o(0), x r \ (0),... .Fortunately, 
this turns out to be easy. It can be shown that x rp (0) is given by 

x rp (0) = x(p) (7.49) 

where p is the r-hit binary representation of p reversed in decimal form. For example, if /V = 
16, r = 4 and hence we have 

x 40 (0) = x(0) 0000 -» 0000 -» x(0) 

a 41 (0) = x(T) -* 0001 1000 -» x(8) 

a 42 (0) = x(2) 0010 -> 0100 x(4) 

X4(15)(0) = x(f5) 1111 -> 1111 —>■ x(15) 
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In effect, sequence {x r o(0), x r i(0), ...} is a reordered version of sequence {jc(0), x(1), ...}, namely, 
WO), x(l), ...} or WO), x(8), ...}. Entering the time sequence, properly reordered in the left- 
hand array in Fig. 7.24 b and performing the computations involved in the signal flow graphs of 
Fig. 7.247> and a will produce the DFT of the given time sequence in the right-hand array of Fig. 7.24« 
properly ordered as illustrated. 

In the above discussion, N has been assumed to be a power of 2. Nevertheless, the algorithm 
can be applied to any other finite-duration time sequence by including a number of trailing zero 
elements in the given sequence. This would amount to zero padding and, as may be recalled from 
Sec. 7.5, including trailing zeros improves the resolution of the frequency spectrum of the discrete¬ 
time signal. 



Construct the decimation-in-time algorithm for N = 8. 


■ Solution 


From Eqs. (7.43a) and (7.43b), we have 


Jtio(n) = x(2 n) x n (n) — x(2 n + 1) 


forn =0, 1, 2, 3. Hence 


xio(n) = {x(0), x(2), x(4), x(6)} 
xn(n) = }x(l), x(3), x(5), x(7)} 


(7.50a) 

(7.50b) 


Now from Eqs. (7.47a)-(7.47d), we obtain 


X 20 («) = xio(2n) xn(n) = x\ 0 (2n + 1) 

X 22 («) = xn(2n) x 23 (n) = xn(2n + 1) 


for n = 0, 1. Thus Eqs. (7.50a) and (7.50b), give 


* 2 o(«) = W0), x(4)} x 2 i(n) = (x(2), x(6)} 

xnin) = (x(l), x(5)} x 23 (n) = (x(3), x(7)} 


(7.51a) 

(7.51b) 


Finally, from Eqs. (7.48a)-(7.48d), the elements of the third cycle can be generated by 
replacing k in the second cycle first by 2k and then by 2k + 1, 


x 30 (n) = x 20 (2«) x 3 i(n) = x 20 (2« + 1) 

x 3 2 (n) = x 2 i(2h) x 33 (n) = x 2 i(2« + 1) 

xm(«) = x 2 2(2 n) x 35 (n) = x 2 i{2n + 1) 

x 3 6 in) = x 23 (2 n) x 37 (n) = x 23 (2 n + 1)] 
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x 3 m x 2 ,<*> x(k) 



Figure 7.25 Decimation-in-time FFT algorithm for N = 8 (Example 7.7). 


for k = 0. Hence from Eqs. (7.51a) and (7.51b), we obtain 


x 30 (0) = jc( 0) = X(0) 
x 32 (0) = x(2) = X(2) 
x 34 (0) = x(l) = X(\) 
x 36 (0) = x(3) = X(3) 


x 3 i(0) = x(4) = Z(4) 
x 33 (0) = x(6) = X(6) 
x 35 (0) = x(5) = X(5) 
x 37 (0) = x(7) = X(7) 


The complete algorithm is illustrated in Fig. 7.25. ■ 


The algorithm can be easily programmed as computations can be carried out in place in a single 
array. As can be observed in Fig. 7.25, once the outputs of each input butterfly are computed, the 
input elements are no longer needed for further processing and can be replaced by the corresponding 
outputs. When we proceed in the same way from left to right, at the end of computation the input 
array will contain the elements of the desired DFT properly ordered. The input elements can be 
entered in the appropriate array locations by using a simple reordering subroutine. 

In general, each cycle of the algorithm involves N/2 butterflies, as can be seen in Fig. 7.25, 
and each butterfly requires one (complex) multiplication. Since there are r cycles of computation 
and r — log-, N, the total number of multiplications is (N/2) log 2 N as opposed to N 2 in the case of 
direct evaluation. This constitutes a huge saving in computation. For example, if N > 512, then the 
number of multiplications is reduced to a fraction of 1 percent of that required by direct evaluation. 
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7.11.2 Decimation-in-Frequency Algorithm 

In the decimation-in-time algorithm, the given time sequence is split in two by separating the even- 
and odd-index elements. The same procedure is then applied repeatedly on each new sequence 
until one-element sequences are obtained. The decimation-in-frequency algorithm can be developed 
by splitting the given sequence about its midpoint and then repeating the same for each resulting 
sequence until one-element sequences are obtained. We can write 

N/ 2-1 N -1 

x(k) = y x ( n )Wf kn + Y x (^ w N kn 

n =0 n—N/2 


N/ 2—1 r 


= E 


n =0 


x(n) + W N kN/2 x [ n + — 


N 


W, 


-kn 


and on replacing k first by 2k and then by 2k + 1, we obtain 


N/ 2-1 

X(2k) = Y x m(n)WN/2 = X m (k) 

71=0 

(7.52a) 

N/2-1 

X(2k+ 1)= Y x n(n)W^ = X n (k) 

(7.52b) 


71=0 


where 


. N 

x\o(n) = x(n) + x ( n + — 


xu (n) = 


. N 
x(n) — x [ n + — 


*v 


(7.53a) 

(7.53b) 


for 0 < n < N/2 — 1. Thus the even- and odd-index values of X(k) are given by the DFTs of xio(n) 
and xu(n), respectively. Assuming that the values of x(n) are stored sequentially in an array, the 
values of xio(n) and x n (n) can be computed as illustrated in Fig. 7.26 a, where the left-hand butterfly 
represents Eqs. (7.53a) and (7.53b). 

The same cycle of activities can now be applied to A‘io(n) and For xio(«), we can write 


N/ 4—1 

X(2 k)= Y, 

77=0 


xio(n) + W N kN, 2 Xi 0 



W, 


-kn 

N/2 


and, similarly, for xn(n) 


X{2 k- 


N/ 4—1 

0= E 


71=0 


Xu in) + W N kN/2 Xu 


N 

~4 


w; 


—kn 
N/2 
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Figure 7.26 Decimation-in-frequency FFT algorithm: (a) First and second cycles. 
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Hence with k replaced first by 2k and then by 2k + 1, we have 


N/ 4—1 


X(4k) = J2 *20 (n)Ww = X 2 o(k) 

n =0 

(7.54a) 

N/ 4-1 

X(4k + 2)= J2 x 2iMW n/4 = X 21 (k) 

n =0 

(7.54b) 

N/ 4-1 

X(4k + 1) = Y, x 22(n)W^ = X 22 (k) 

n =0 

(7.54c) 

V/4-1 

X(4fc + 3) = ^ *23(n)W^ = X 2i (k ) 

(7.54d) 


n =0 


where 


*20 in) = xio(n) + xio 


*2i(«) = 


*io(«) - x 10 


X2i(n) = Xu(n) + xu 


*23 (n) = 


*11 («) - *n 



W~ 2n 


W 2 ' 


(7.55a) 

(7.55b) 

(7.55c) 

(7.55d) 


for 0 < n < (N/ 4 — 1). The values of x 2 o(n), *21 (n), ... can be computed as in Fig. 7.26 a. The DFT 
of each of these sequences gives one-quarter of the values of X(k). 

Similarly, the mth cycle of the above procedures would yield 


JVi-l 


X(2'”k) = x m0 (n)W^ n = X m0 (k) 

n =0 
Ni-\ 

X(2 m k + 2"'- 1 ) = J2 x m i(n)W^ n = X ml (k ) 


n =0 


(7.56a) 

(7.56b) 


where N\ = N/2 m and 


X m o(n) — *(m — l)o(zz) T *(m—1)0 ( tZ “f~ 


N 


Xml (n) 


X 

*(m—l)o(tt) *(/n— 1)0 [ ZZ T 


W. 


—2 m 


for 0 < n < N /2 m — 1. 
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As for the decimation-in-time algorithm, the procedure terminates with the rth cycle at which 
point x r Q (n), x, \ (n ), ... reduce the one-element sequences each giving one value of the desired DFT 
except that the elements of the DFT are not properly ordered. What we get instead is the sequence 


X(0) = x r0 (0) 

(7.57a) 

X(l) = *,!(()) 

(7.57b) 

X{p) = x rp (0 ) 

(7.57c) 

X(N - 1) = Jtr(JV-t)(0) 

(7.57d) 


where p is the r-bit binary representation of p reversed in decimal form as in the decimation-in-time 
algorithm. The last two cycles of the algorithm are illustrated in Fig. 7.26 b. Note that the elements 
of the DFT can be put in the right order by simply reversing the r-bit binary representation of the 
location index at the end of the computation, as is done for the input sequence in the case of the 
decimation-in-time algorithm. The advantage of this algorithm is that the values of x(n ) are entered 
in the input array sequentially. 


*0-i);(") V") 



X(0) 

X(T) 


X(l) 


C b) 


Figure 7.26 Cont’d Decimation-in-frequency FFT algorithm: (b) rth cycle. 
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Example 7.8 


Construct the decimation-in-frequency algorithm for N = 8. 


■ Solution 


From Eqs. (7.52a) and (7.52b), we have 

X w (k) = X(2k) and X u (k) = X(2 k + 1) 
for k = 0, 1, 2, 3. Hence 

*io(*) = {*(0), X(2), X(4), X(6)} (7.58a) 

X n (k) = {*(1), X(3), X(5), X(7)} (7.58b) 

From Eqs. (7.54a)-(7.54d), we have 

X 20 (k) = X(4k) X 2 i (k) = X(4 k + 2) 

X 22 (k) = X(4k + 1) X 23 (k) = X(4k + 3) 

for k = 0, 1. Thus Eqs. (7.58a) and (7.58b), give 

X 20 (k) = {X(0), X(4)} X 21 (k) = {X{2\ X(6)} (7.59a) 

X 22 (k) = (Z(l), Z(5)} X 23 (k) = (X(3), X(l)} (7.59b) 

Finally, from Eqs. (7.56a) and (7.56b) or Eqs. (7.57a)-(7.57c), the elements of the 3rd 
cycle can be generated by replacing k in the 2nd cycle first by 2k and then by 2k + 1, 
that is, 


X 30 (k) = X[4(2 k)] X 3l (k) = X[4(2 k + 1)] 

X 32 (k) = X[4{2k) + 2)] X 33 (k) = X[4(2k + 1) + 2] 

X 34 (k) = X[4(2k) + 1] X 35 (k) = X[4(2 k + 1) + 1] 

X 36 (k) = X[4(2k) + 3] X 31 (k) = X[4(2k + 1) + 3] 


for k — 0. Hence from Eqs. (7.59a) and (7.59b), we obtain 

Z 30 (0) = X(0) = x(0) X 3 j(0) = X(4) = x{4) 

Z 32 (0) = X(2) = x(2) X 33 (0) = X(6) = x(6) 

X 34 (0) = X(l) = x(l) X 35 (0) = X(5) = x(5) 

x 36 (0) = X(3) = x(3) X 31 (0) = Z(7) = x(7) 


The complete algorithm is illustrated in Fig. 7.27. ■ 
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m 


X u (k) 




X 3i (k) 



X(0) 

X(4) 

X(2) 

X(6) 

X(l) 

X(5) 

X(3) 

X(7) 


Figure 7.27 Decimation-in-frequency FFT algorithm for (V = 8 (Example 7.8). 


7.11.3 Inverse DFT 

Owing to the similarity between Eqs. (7.1) and (7.2), the preceding two algorithms can be readily 
employed for the computation of the 1DFT. Equation (7.2) can be put in the form 


or 


x*(n) 


1 

N 


iV-l 

J2 X(k)W k " 

k=0 


1 

N 


N -1 

X*(k)W~ kn 

k =0 


x*(n) = V 


1 

N 


X*(k ) 


Therefore, 


x(n) = < V 


N 


X*(k) 


Thus if a computer program is available that can be used to compute the DFT of a complex signal 
x(n), then exactly the same program can be used to compute the inverse DFT, i.e., x(n), by entering 
the complex conjugate of X(k)/N as input and then taking the complex conjugate of the output. 
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7.12 APPLICATION OF THE FFT APPROACH 
TO SIGNAL PROCESSING 

The processing of discrete-time signals can be carried out through the use of a digital filters in the 
form of software or hardware. Alternatively, one can simulate the action of a digital filter through 
the use of the convolution summation. 

The response of an FIR filter to an excitation x(n) is given by 


OO 

y(n) = x(n — m)h(m) 

m =—oo 

and if 

h(n) = 0 for n < 0 and n > N — 1 

x(n) = 0 for n < 0 and « > L — 1 

then we have 

N -1 

y(n) = x(n — m)h(m) for 0<n<N + L — 2 (7.60) 

m =0 


A software implementation for the filter can be readily obtained by programming Eq. (7.60) directly. 
However, this approach can involve a large amount of computation since N multiplications are 
necessary for each sample of the response. The alternative is to use the FFT method [12], 

Let us define (L + N — l)-element DFTs for h(n), x(n), and y(n), as in Sec. 7.2, which we 
can designate as H{k), X(k), and Y(k), respectively. From Eqs. (7.39) and (7.60), we have 

Y(k) = H(k)X(k ) 

and hence 

y(n) = V~ l [H(k)Xm 

Therefore, an arbitrary finite-duration signal can be processed through the following procedure: 

1. Compute the DFTs of h(n) and x(n) using an FFT algorithm. 

2. Compute the product H(k)X(k ) for k — 0, 1. 

3. Compute the IDFT of Y(k) using an FFT algorithm. 

The evaluation of H(k ), X(k), or yin) requires [(L + N — 1 )/2] log 2 (L + N — 1) complex multiplica¬ 
tions, and step 2 above entails L + N — 1 of the same. Since one complex multiplication corresponds 
to four real ones, the total number of real multiplications per output sample is 6 log 2 f L + N — 1) + 4, 
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as opposed to N in the case of direct evaluation using Eq. (7.60). Clearly, for large values of N, the 
FFT approach is much more efficient. For example, if IV = L — 512, the number of multiplications 
would be reduced to 12.5 percent of that required by direct evaluation. 

The above convolution method of implementing digital filters can also be applied to HR digital 
filters but only if the frequency response of the filter is bandlimited. In such a case, an impulse 
response of finite duration can be obtained through the use of a suitable window function. 

In the convolution method for the implementation of digital filters, the entire input sequence 
must be available before the processing can start. Consequently, if the input sequence is long, a 
long delay known as latency will be introduced, which is usually objectionable in real-time or even 
quasi-real-time applications. For such applications, the input sequence is usually broken down into 
small blocks or segments that can be processed individually. In this way, the processing can begin as 
soon as the first segment is received and the processed signal begins to become available soon after. 
Simultaneously, new segments of the input continue to be received while the processing continues. 

Two segmentation techniques have evolved for the processing of signals, as follows: 

1. Overlap-and-add method 

2. Overlap-and-save method 

These are two somewhat different schemes of dealing with the fact that the periodic convolution 
produces a longer sequence than the length of either the signal x(n) or the impulse response h(n) of 
the filter being simulated. 


7.12.1 Overlap-and-Add Method 

In the overlap-and-add method, successive convolution summations produce consecutive processed 
segments of the signal that are overlapped to give the overall processed signal as will be shown 
below. 

The input signal can be expressed as a sum of signal segments jc,-(n) for i = 1,2, ... , q, 
each comprising L samples, such that 





for 0 < n < qL — 1, where 



for iL < n < (i + 1)L — 1 
otherwise 


(7.61) 


as illustrated in Fig. 7.28. With this manipulation, Eq. (7.60) assumes the form 


N -1 q 
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x(n) 


llli 


III illll.lill.l 


x 0 (n) 


\ 

2 L 


\ H 

3 L 


L -1 


(«) 


U 


x 2 (n) 


L 2L—1 

+ 


! " 

2 L 3L-1 


Figure 7.28 Segmentation of input sequence. 


and on interchanging the order of summation, we get 


y(n) = > 


i=0 


where 


din) = Xj (n — m)h(m) 


m= o 


In this way, y(n) can be computed by evaluating a number of partial convolutions. 


(7.62) 


(7.63) 
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For iL — \ <«<(;' + 1 )L + N — 1, Eqs. (7.63) and (7.61) give 


Ci(iL - 1 ) = 0 

Ci(iL) = x{iL)h(0) 

Cj(iL + 1) = xiiL + l)/i(0) + x(iL)h( 1) 


c,-[(i + 1 )L + N — 2] = x[(i + 1 )L — l]/i(Af — 1) 

Cj[(/ + l)L + N- 1] = 0 

Evidently, the i th partial-convolution sequence has L + N — 1 nonzero elements which can be stored 
in an array C, , as demonstrated in Fig. 7.29. From Eq. (7.63), the elements of C, can be computed as 

c l (n) = V-'[H(k)X l (k)] 

Now from Eq. (7.62), an array Y containing the values of yin) can be readily formed, as illustrated 
in Fig. 7.29, by entering the elements of nonoverlapping segments in Co, C i,... and then adding 


C 0 • • • • • • 

I I I 


0 


+ 


L L+N-2 


t t 

2 L 2L+N-2 



Overlap 


Figure 7.29 Overlap-and-add implementation. 
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the elements in overlapping adjacent segments. As can be seen, processing can start as soon as L 
input samples are received, and the first batch of L output samples is available as soon as the first 
input segment is processed. Evidently, a certain amount of latency is still present but through the 
overlap-and-add method, this is reduced from (qL — 1 )T to (L — I )T s where T is the sampling 
period. 

7.12.2 Overlap-and-Save Method 

If x{n) = 0 for n < 0 as before, then the first L elements of convolution summation coin), namely, 
elements 0 to L — 1, are equal to the corresponding L elements of yin). However, this does not apply 
to the last N — 1 elements of coin), i.e., elements L to L + N — 2, owing to the overlap between 
convolutions coin) and (yin) as can be seen in Fig. 7.29. This problem can be avoided through the 
following scheme. 

If we define x\(n) such that 

f xin) for L — {N — 1) < n < 2L — iN — 1) — 1 

x\in) = < 

I 0 otherwise 

as illustrated in Fig. 7.30, then the convolution of x\in) with h(n) would assume the form 


n- t 

ciin) = x\in — m)h{m) for L — iN — 1) < n < 2L — 1 

m =0 

Straightforward evaluation of ci(n) for n — L, L + N — 2, and 2Z. — (TV — 1) — 1 gives 

cj(L) = xi(L)hiO) + xiiL - l)/t(l) + ■ ■ • + X!(L - N + l)h(N - 1) 

= c 0 (L) + Cl iL) = yiL) 

ci(L + N- 2) = xUL + N — 2)h(0) + x^L + N - 3)/t(l) + • • • 

+X\(L - 1 )h(N- 1) 

= coiL + N - 2) + aiL + N - 2) = yiL + N - 2) 

C\[2L -iN - 1)- 1] = xi(2L - N)h(0) + xi(2L -N - l)/z(l) + ••• 

+xi(2L -2N+ 1 MN - 1) 

= c\[2L - iN - 1) - 1] = y[2L - (N - 1) - 1] 

where c,-(n) for i — 0, 1 are given by Eq. (7.63) and L is assumed to be greater than 2(/V — 1) for 
the sake of convenience. Evidently, 


IV-1 

ci{n) = E xin — m)h(m) = yin) for L < n < 2L — (N — 1 ) — 1 

m =0 

that is, ci(n) gives elements L to 2L — (N — 1) — 1 of the required output, which can be stored in 
the unshaded part of array C\ in Fig. 7.31. 
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x\{n) 


iill 


x 2 (n) 


L-(N- 1) 2L—(N—l)—\ 


LlLL 


+ ' r 

2L—2(N— 1) 3L—2(Af—1)—1 


Figure 7.30 Alternative segmentation of input sequence. 


Similarly, by letting 

( x(n) for iL — (i — [)(N — 1) < n < (; + 1 )L — i(N — 1) — 1 

Xi(n ) = < 

10 otherwise 

one can easily show that for iL — (i — l)(N — 1) < n < (i + 1 )L — i(N — 1) — 1 

c,(n) = y(n) (7.64) 

for i = 2, 3,... (see Prob. 7.34). In effect, the processed signal can be evaluated by computing the 
first L elements of co(n) and elements iL — (i — l)(iV — 1) to (i + 1 )L — r (TV — 1) — 1 of the partial 
convolutions Ci(n) for i = 1,2,... , and then concatenating the sequences obtained as shown in 
Fig. 7.31. 

In the scheme just described, the input sequences rather than the output sequences are over¬ 
lapped, as can be seen in Fig. 7.30, and the last N — \ elements of each input sequence are saved 
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| | 

L L + N-2 


L-(N- 1) 


t t t 

L 2L—(N—\)—\ 2L—1 


2L-(N-l) 


3L—(N—l )— 1 


2L—2(N— 1) 3L-2(N-1)-1 

t t t 


N -1 


L -1 


H- 


-H—CjhH 


Figure 7.31 Overlap-and-save implementation. 


to be re-used for the computation of the next partial convolution. For these reasons, the scheme is 
known as the overlap-and-save method. 
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PROBLEMS 

7.1. Show that 



for m = n 
otherwise 


7.2. Show that 

(a) Vx{nT + mT) = W km X(jktt) 

(b) V~ l X(jkSl + jlQ.) = W~ n 'x(nT) 

7.3. The definition of the DFT can be extended to include complex discrete-time signals. Show that 

(a) Vx*(nT) = X*(-jkQ.) 

(b) V- l X*(jkQ) = x*(—nT) 

7.4. (a) A complex discrete-time signal is given by 

x{nT) — xfiiT) + jx 2 {nT) 
where x\(nT) and x 2 (nT) are real. Show that 


the XJjkQ) = I[9\e X(jktt) + V\e X[j(N - k)£l]} 
3m XfjkQ.) = \{3m X{jkQ.) - 3m X[j{N - Jfc)£2]} 
<He X 2 (jkQ) = | {3m X(jk£2) + 3m X[j{N - jfe)£2]} 
3m X 2 (jkQ) = X(jktt) - V\e X[j(N - k)Q ]} 


(. b ) A DFT is given by 


xum = XfjkQ) + jX 2 (Jka) 


where Xi(jk£l) and X 2 (jk£2) are real DFTs. Show that 


mexiinT) = \{Kex(nT) + 9\ex[(N-n)T]} 
3mxfnT) = \{3mx{nT)-3mx[{N -n)T}} 
<Rex 2 (nT) = \{3mx(nT) + 3mx[(N - n)T}} 
3mx 2 {nT) = -I{9lex(nT) - 3\ex[(N - n)T]} 
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7.5. Figure P7.5 shows four real discrete-time signals. Classify their DFTs as real, imaginary, or complex. 
Assume that N = 10 in each case. 



(a) 


x(nT ) 

. i 1 1 

■ 1 1 1 



| 1 1 10 

nT 

| | 1 ' 20 


x(nT ) 




(d) 


Figure P7.5 


7.6. Find the DFTs of the following periodic signals: 
'1 for n = 3,1 
|0 for n = 0, 1,2,4, 5,6, 8, 9 
1 for 0 < n < 5 

I 2 for 6 < n < 9 


(a) x(nT) = 


(b) x(nT) = 


7.7. Find the DFTs of the following periodic signals: 

f 2e~ an for 0 < n < 5 

[0 for 6 < n < 9 

The period is 10 in each case. 


(a) x(nT) = 
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7.8. 


7.9. 


7.10. 


7.11. 

7.12. 


7.13. 

7.14. 

7.15. 

7.16. 

7.17. 

7.18. 

7.19. 


{ n for 0 < n <2 

0 for 3 < n < 7 

—(10 — n) for n = 8, 9 
The period is 10 in each case. 

Find the DFTs of the following periodic signals in closed form: 

(a) x(n) = e-P" for 0 < n < 31 if N = 32. 

(b) Repeat part (a) for x(n) = e _y "/2 e for 0 < n < 31 if IV = 32. 
A periodic signal is given by 


OO 

x(nT) = E w H (nT + rNT ) 

r=—o o 


where 


Wn(nT) = 


a + (1 — a) cos 

0 


2nn 
N - 1 


for| n\ < 


N - 1 


2 


otherwise 


Find X(jkQ,). 

Obtain the IDFTs of the following: 

, / 2nk 

(a) X(jktt) = (-1)* 1 + 2 cos- 


C b ) X(jkQ) = l + 2j(-l) k 
The value of A is 10. 

(a) Find the z transform of x(nT ) for the DFTs of Prob. 7.10. Assume that x(nT) = 0 outside the range 
0 < n < 9 in each case. 

(a) Working from first principles, derive an expression for the frequency spectrum of the rectangular 
window of length 31 in closed form. 

(b) Repeat part (a) for a window length of 32. 

(a) Starting with Eq. (7.25), derive Eq. (7.29). 

(b) Starting with Eq. (7.27), derive Eq. (7.32). 

Show that the Kaiser window includes the rectangular window as a special case. 

Compute the values of the Kaiser window of length N w = 7 and a — 3.0. 

Construct Table 7.1 for a Kaiser length of length 31. 

Function Wy{{nT ) in Prob. 7.9 with a = 0.54 is known as the Hamming window. Obtain a closed-form 
expression for the frequency spectrum of the window. 

Using MATLAB or similar software, plot the ripple ratio and main-lobe width of the Flamming window 
described in Prob. 7.17 as a function of the window length. 


( 3kn Akji \ 

sin-F sin- 

V 5 5 ) 


The triangular window 4 is given by 


vi-m{nT) = 



for \n\ < 


N - 1 


2 


otherwise 


4 This is also known as the Bartlett window. 
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(a) Assuming that i«tr(0 is bandlimited, obtain an approximate expression for W-r^{e iwT ). 
(, b ) Estimate the main-lobe width if N 1. 

(c) Estimate the ripple ratio if N S> 1. 

{Hint. See Prob. 6.27.) 

7.20. An infinite-duration discrete-time signal is described by 


x(nT) = u(nT) [ A 0 e po " T + 2M\e ai ' cos(a>i nT + $i)] 


where A 0 = 4.532, Mi = 2.350, = —2.873 rad, p 0 = —2.322, = —1.839, and a>i = 1.754 rad/s. 

(a) Obtain an expression for the frequency spectrum of the signal. 

(b) Plot the frequency spectrum over the range 0 < a> < u) s /2 assuming a sampling frequency a> s = 
10 rad/s. 

(c) Repeat part ( b ) if the signal is modified through the use of a rectangular window of length 21. 

0 d ) Repeat part ( b ) if the signal is modified through the use of a Kaiser window of length 21 and a = 1.0. 
(e) Compare the results obtained in parts (c) and ( d). 

7.21. An infinite-duration right-sided discrete-time signal x(nT) is obtained by sampling the continuous-time 


signal 


x(t) = u(t)[A 0 e pat + 2Mie ait cos(a>i t + 6>i)] 


where A 0 = 5.0, M i = 2.0, = —3.0 rad, p 0 — —2.0, 0 \ = —1.5, and a>i = 2.5 rad/s. A finite 

duration signal can be obtained by applying the discrete-time Kaiser window with a = 2.0. Following 
the approach in Example 7.5, find the lowest sampling frequency that would result in negligible aliasing 
error. 

7.22. Repeat Prob. 7.21 if A 0 = 4.0, Mi = 3.0, Qi = —2.0 rad, p 0 = —3.0, ai = —2.0, a>i = 1.5 rad/s, and 
a = 1.5. 

7.23. Prove Theorem 6.2B. 

7.24. (a) Periodic signals x(n ) and h(n) are given by 


x(n) 


1 for 0 < n < 4 

2 for 5 < n < 9 


h(n) = n for 0 < n < 9 


Find the time-domain convolution 


9 


y(n) = 'y x(m)h(n — m) 


at n = 4 assuming a period N = 10. 
(, b ) Repeat part (a) if 


x{n) = u(n — 4)e a " for 0 < n < 9 h{n) = 



n = 0, 1,8,9 
otherwise 


7.25. Two periodic signals are given by 


x{n) = cosn7r/9 and h(n) = u{n — 4) for 0 < n < 9 


Find the time-domain convolution y(n) at n = 5 assuming that N = 10. 
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(. b ) Repeat part (a) if 


x(n) = cosnn/9 and 


7.26. Show that 



for 0 < n < 3 
otherwise 


T> [x(n)h(n)\ = 


1 

- XI X W H (k - m '> 

m =0 


where X(k) = Vx(n) and //(£) = T>h{ti). 

7.27. Construct the flow graph for a 16-element decinration-in-time FFT algorithm. 

7.28. Construct the flow graph for a 16-element decimation-in-frequency FFT algorithm. 

7.29. (a) Compute the Fourier-series coefficients for the periodic signal depicted in Fig. P7.29 by using a 

32-element FFT algorithm. 

(b) Repeat part (a) using a 64-element FFT algorithm. 

(c) Repeat part (a) using an analytical method. 

0 d ) Compare the results obtained. 



Figure P7.29 


7.30. Repeat Prob. 7.29 for the signal of Fig. P7.30. 



7.31. (a) Compute the Fourier transform of 


x(t) = 


j ^(1 + cos?) 

\o 


for 0 < \t\ < n 
otherwise 


by using a 64-element FFT algorithm. The desired resolution in the frequency domain is 0.5 rad/s. 

(b) Repeat part (a) for a frequency domain resolution of 0.25 rad/s. 

(c) Repeat part (a) by using an analytical method. 

(i i) Compare the results in parts (a) to (c). 
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7.32. Repeat Prob. 7.31 for the signal 


rfrt= /!-W for |f| < 1 

' ' |^0 otherwise 

The desired frequency-domain resolutions for parts (a) and ( b ) are 7r/4 and 7r/8 rad/s, respectively. 

7.33. An FFT program is available which allows for a maximum of 64 complex input elements. Show that this 
program can be used to process a real 128-element sequence. 

7.34. Demonstrate the validity of Eq. (7.64). 


CHAPTER 

8 


REALIZATION 
OF DIGITAL 
FILTERS 


8.1 INTRODUCTION 

The previous chapters considered the basics of signal analysis and the characterization and analysis 
of discrete-time systems. From this chapter onward, the design of discrete-time systems that can 
be used in DSP will be examined in great detail. Discrete-time systems come in all shapes and 
forms. However, this textbook is concerned with discrete-time systems that can be used to reshape 
the spectral characteristics of discrete-time signals, and such systems are of course digital filters be 
it nonrecursive or recursive, FIR or HR filters, one- or two-dimensional, single-rate or multirate, 
adaptive or fixed. 

In broad terms, the design of digital filters encompasses all the activities that need to be 
undertaken from the point where a need for a specific type of digital filter is identified to the point 
where a prototype is constructed, tested, and approved. The compendium of activities that need to 
be undertaken to obtain a design can be packaged into four basic steps, as follows: 

1. Approximation 

2. Realization 

3. Study of arithmetic errors 

4. Implementation 

When performed successfully, these steps would lead to the implementation of a digital filter that 
would satisfy a set of prescribed specifications which would depend on the application at hand. 
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The approximation step is the process of generating a transfer function that would satisfy the 
desired specifications, which may concern the amplitude or phase response or even the time-domain 
response of the filter. The available methods for the solution of the approximation problem can be 
classified as direct or indirect. In direct methods, the problem is solved directly in the z domain. 
In indirect methods, a continuous-time transfer function is first obtained and then converted into 
a corresponding discrete-time transfer function. Nonrecursive filters are always designed through 
direct methods whereas recursive biters can be designed either through direct or indirect methods. 
Approximation methods can also be classibed as closed-form or iterative. In closed-form methods, 
the problem is solved through a small number of design steps using a set of closed-form formulas. In 
iterative methods, an initial solution is assumed and, through the application of optimization methods, 
a series of progressively improved solutions are obtained until some design criterion is satisbed. In 
general, the designer is interested in approximation methods that 

• are simple, 

• are reliable, 

• yield precise designs, 

• require minimal computation effort, and so on. 

The realization or synthesis of a digital biter is the process of generating a digital-biter network 
or structure from the transfer function or some other characterization of the biter. The network ob¬ 
tained is said to be the realization of the transfer function. As for approximation methods, realization 
methods can be classibed as direct or indirect. In direct methods the realization is obtained directly 
from a given discrete-time transfer function whereas in indirect realizations, the biter structure is 
obtained indirectly from an equivalent prototype analog biter. Many realization methods have been 
proposed in the past that lead to digital-biter structures of varying complexity and properties. The 
designer is usually interested in realizations that 

• are easy to implement in very-large-scale integrated (VLSI) circuit form, 

• require the minimum number of unit delays, adders, and multipliers, 

• are not seriously affected by the use of bnite-precision arithmetic in the implementation, and so 
on. 

Designs of all types from that of a refrigerator or an electrical drill to that of a microwave com¬ 
munications channel entail imperfections of various sorts brought about by modeling inaccuracies, 
component tolerances, unusual or unexpected nonlinear effects, and so on. A design will be approved 
to the extent that design imperfections do not violate the desired specibcations. In digital biters and 
digital systems in general, most imperfections are caused by numerical imprecision of some form 
and studying the ways in which numerical imprecision will manifest itself needs to be undertaken. 
During the approximation step, the coefficients of the transfer function are determined to a high 
degree of precision. In practice, however, digital hardware have bnite precision that depends on the 
length of registers used to store numbers; the type of number system used (e.g., signed-magnitude, 
two’s complement); the type of arithmetic used (e.g., bxed-point or boating-point), and so on. Con¬ 
sequently, biter coefficients must be quantized (e.g., rounded or truncated) before they can be stored 
in registers. When the transfer function coefficients are quantized, errors are introduced in the ampli¬ 
tude and phase responses of the biter, which are commonly referred to as quantization errors. Such 
errors can cause the digital biter to violate the required specibcations and in extreme cases even to 
become unstable. Similarly, the signals to be processed as well as the internal signals of a digital 
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filter (e.g., the products generated by multipliers) must be quantized. Since errors introduced by the 
quantization of signals are actually sources of noise (see Sec. 14.5). they can have a dramatic effect 
on the performance of the filter. Under these circumstances, the design process cannot be deemed 
to be complete until the effects of arithmetic errors on the performance of the filter are investigated 
and ways are found to mitigate any problems associated with numerical imprecision. 

The implementation of a digital filter can assume two forms, namely, software or hardware , 
as detailed in Sec. 1.8. In the first case, implementation involves the simulation of the filter network 
on a general-purpose digital computer, workstation, or DSP chip. In the second case, it involves the 
conversion of the filter network into a dedicated piece of hardware. The choice of implementation is 
usually critically dependent on the application at hand. In nonreal-time applications where a record of 
the data to be processed is available, a software implementation may be entirely satisfactory. In real¬ 
time applications, however, where data must be processed at a very high rate (e.g., in communication 
systems), a hardware implementation is mandatory. Often the best engineering solution might be 
partially in terms of software and partially in terms of hardware since software and hardware are 
highly exchangeable nowadays. 

The design of digital filters may often involve other steps that do not appear explicitly in the 
above list. For example, if a digital filter is required to process continuous-time signals, the effects 
of the interfacing devices (e.g., analog-to-digital and digital-to-analog converters) on the accuracy 
of processing must be investigated. 

The natural order of the four basic design steps is as stated in the preceding discussion, namely, 
approximation, realization, study of imperfections, and implementation. However, realization is that 
much easier to learn than the approximation process and for this reason it will be treated first, 
in this chapter, along with some implementation aspects. The approximation step is a multifaceted 
activity that involves a diverse range of principles since there are many types of digital filters and many 
methodologies to choose from. It even necessitates on occasion the design of analog filters since some 
of the best HR filters can be derived only from analog filters. The approximation step for FIR filters 
is considered in Chap. 9, for analog filters in Chap. 10, for HR filters in Chaps. 11 and 12. Chapters 
13 and 14 have to do with the study of numerical errors associated with the use of finite word length 
in digital hardware. Some more advanced, optimization-based, approximation methods for FIR and 
HR filters can be found in Chaps. 15 and 16. Chapter 17 deals with a fairly advanced class of digital 
filters, namely, the class of wave digital filters which are known to possess certain highly desirable 
properties, and Chap. 18 which concludes the book deals with a variety of digital-filter applications. 

8.2 REALIZATION 

As stated in the introduction, two types of realization methods have evolved over the past 30 to 
40 years, namely, direct and indirect. In direct methods, the transfer function is put in some form 
that enables the identification of an interconnection of elemental digital-filter subnetworks. The most 
frequently used direct realization methods of this class are [1—4], as follows: 

1. Direct 

2. Direct canonic 

3. State-space 

4. Lattice 

5. Parallel 

6. Cascade 
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In indirect methods, on the other hand, a given analog-filter network is represented by the so-called 
wave characterization, which is normally used to represent microwave circuits and systems, and 
through the use of a certain transformation the analog-filter network is converted into a topologically 
related digital-filter network [5-8]. 


8.2.1 Direct Realization 

A filter characterized by the iVth-order transfer function 


H(z) = 


N(z) 

D(z) 


! + Ef = i ba - 1 


can be represented by the equation 

Y(z ) = = tffe) = N{z ) 

X(z) " D(z) 1 + D'(z) 

N 

where N(z) = ^atz^ 

i =0 
N 

and D'(z) = '^2b i z~ i 

i =1 


(8.1a) 


(8.1b) 


(8.2a) 


(8.2b) 


From Eq. (8.1b), we can write 

Y(z) = N(z)X(z ) - D'(z)Y(z) 


or Y(z)= U l (z) + U 2 (z) 

where Ui(z) = N{z)X(z) (8.3a) 

and U 2 (z.) = - D'(z)Y(z ) (8.3b) 

and hence the realization of II(z.) can be broken down into the realization of two simpler transfer 
functions, N(z) and — Z)'(z), as illustrated in Fig. 8.1. 

Consider the realization of N(z)- From Eqs. (8.2a) and (8.3a) 

U 1 (z)=[a 0 + z~ l N 1 (z)]X(z) 


N 

Ni(z ) = y^q,z~' +i 

1=1 


where 
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and thus N(z ) can be realized by using a multiplier with a constant a o in parallel with a network 
characterized by N\(z). In turn, z _1 IVi(z) can be realized by using a unit delay in cascade with a 
network characterized by /V| (z). Since the unit delay can precede or follow the realization of /V| (z), 
two possibilities exist for N(z), as depicted in Fig. 8.2. 

The above procedure can now be applied to IVi(z). That is, /V] (z) can be expressed as 

N 

N\(z) = a\+ z~ l N 2 (z ) where N 2 (z) = ^ a t z ~ l+2 

i=2 

and as before two networks can be obtained for N\(z). Clearly, there are four networks for N(z). 
Two of them are shown in Fig. 8.3. 



Figure 8.2 Two realizations of N(z). 
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Figure 8.3 Two of four possible realizations of N(z). 


The above cycle of activities can be repeated N times whereupon A'.vl") will reduce to a single 
multiplier. In each cycle of the procedure there are two possibilities, and since there are N cycles, 
a total of 2 n distinct networks can be deduced for N ("). Three of the possibilities are depicted in 
Fig. 8.4 a to c. These structures are obtained by placing the unit delays consistently at the left in 
the first case, consistently at the right in the second case, and alternately at the left and right in the 
third case. Note that in the realization of Fig. 8.4a, the adders accumulate the products generated 
by the multipliers from the top to the bottom of the realization. If they are added from the bottom 
to the top, the structure of Fig. 8.4c/ is obtained, which can form the basis of systolic structures 
(see Sec. 8.3.2). 

— D'(z) can be realized in exactly the same way by using Eqs. (8.2b) and (8.3b) instead of 
Eqs. (8.2a) and (8.3a) the only differences being the negative sign in — D'{z ) and the fact that the 
first term in I)'(z) is b\ not bo. Thus a network for — D'(z) can be readily obtained by replacing 
a o, a i, d 2 , ... in Fig. 8.4a by 0, —b\, —bi, .... 

Finally, the realization of H(z) can be accomplished by interconnecting the realizations of 
N(z) and — D'(z ) as in Fig. 8.1. 
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Figure 8.4 Four possible realizations of N(z). 


Example 8.1 


Realize the transfer function 


H(z) = 


ao + a\z 1 + ci2Z 2 
1 + b\z~ l + b2Z~ 2 


■ Solution 

Two realizations of H(z) can be readily obtained from Fig. 8.4a and b, as shown in 
Fig. 8.5a and b. m 


8.2.2 Direct Canonic Realization 

The smallest number of unit delays required to realize an /Vth-order transfer function is N. An 
/Vth-order discrete-time network that employs just N unit delays is said to be canonic with respect 
to the number of unit delays. The direct realization of the previous section does not yield canonic 
structures but through the use of a specific nonrecursive realization from those obtained through the 
direct realization it is possible to eliminate half of the unit delays, as will now be shown. 
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«0 



(C) 



(d) 


Figure 8.4 Cont’d Four possible realizations of i\'(z). 


Equation (8.1b) can be expressed as 

Y(z) = N(z)Y'(z ) 


where 

Y ‘Xz) = , X( '\ , or Y'(z) = X(z) - D'(z)Y'(z) 

1 + D'(z) 

With this manipulation, H(z) can be realized as shown by the block diagram in Fig. 8.6a. On using the 
nonrecursive network of Fig. 8.4a for both N(z) and —D\z) in Fig. 8.6a, the realization of Fig. 8.6 b 
can be obtained after replacing 2-input by multiinput adders. As can be observed in Fig. 8.6 b, the 
signals at nodes A', B f ,... are equal to the corresponding signals at nodes A, B, .... Therefore, 
nodes A', B\ ... can be merged with nodes A , respectively, and one set of unit delays can 

be eliminated to yield a more economical canonic realization. 
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(«) 



(b) 


Figure 8.5 Two possible realizations of H{z) (Example 8.1): (a) Using the structure in Fig. 8.4a, ( b ) using 
the structure in Fig. SAb. 


8.2.3 State-Space Realization 

Another approach to the realization of digital filters is to start with the state-space characterization 


q {nT + T) — Aq(nr) + b x{nT) 
y(nT ) = c r q (nT) + dx(nT) 


(8.4a) 

(8.4b) 
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(b) 

Figure 8.6 Derivation of the canonic realization of H(z)' (a) Block diagram, ( b ) possible realization. 


For an A^th-order filter, Eqs. (8.4a) and (8.4b) give 

N 

qi(nT + T) = y ^a^gjinT) + bjX(nT) fori = 1, 2,..., N (8.5) 

7=1 


and 


N 

y(nT ) = ^^ c jqj(nT) + dox(nT ) (8.6) 

7 = 1 

respectively. By assigning nodes to x(nT), y(nT), qi(nT), and qi(nT + T) for i = 1,2,..., N, 
the state-space signal flow graph of Fig. 8.7 can be obtained, which can be readily converted into a 
network. 
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y(nT) 


Example 8.2 


(8.4b) with 


A digital filter is characterized by the state-space equations in Eqs. (8.4a) and 


r 1 1 

2 3 

1- 

4 


~2 

l 

0 

0 

b = 

0 

_ 0 

i 

0 _ 


0_ 


Obtain a direct canonic realization. 


■ Solution 


In order to obtain a direct canonic realization, we need to deduce the transfer function 
of the filter. From Eq. (5.9) and Example 5.4, we have 


Y(z) 

X(z) 


H(z) = = c r (zl — A) -1 b ■ 


D(z ) 


1 


det(zl — A) 

1 

det(zl — A) 


hi 

[" 


1 -1 
4 6 12 J 


+ \ 

(z + \)z 


--z 

1 

4 


i i -11 

4 6 12 J 


1 

2z 2 ' 
—2 z 
2 


-(z+ \) {z + \)z+ 5 



'2 


0 


0 
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where 


det(zl - A) = z 3 + h 2 + \z + \ 


Thus polynomials N(z ) and D(z) can be deduced as 

2 z 2 

^fe)=[-H^] “ 2z + 2 det(zl — A) 

2 


= 2z 3 


h 2 + h + l 


and 


D(z) = det(zl - A) = z 3 + \z 2 + \z + 5 


respectively. Therefore, 


H(z) = 


2 z 3 + \z 2 + \z + | 
z 3 + jZ 2 + 5 z + l 


2 + \z 1 + \z 2 + \z 3 
1 + \z~ l + \z ~ 2 + \z ~ 3 


The required realization is shown in Fig. 8.8 where 


a 0 = 2 


a\ 


1 

2 


d 2 


1 

3 


Cl3 = 


2 

3 


b\ = \ b 2 = \ £ 3=5 ■ 



Figure 8.8 Canonic realization (Example 8.2). 
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8.2.4 Lattice Realization 

Yet another method is the so-called lattice realization method of Gray and Markel [4], This is based 
on the configuration depicted in Fig. 8.9a. The networks represented by the blocks in Fig. 8.9a 
can assume a number of distinct forms. The most basic section is the 2-multiplier first-order lattice 
section depicted in Fig. 8.9£>. 

A transfer function of the type given by Eq. (8. la) can be realized by obtaining values for the 
multiplier constants Vo, iq, ... ,v N and /i \, /r 2 ,... , /x.v in Fig. 8.9a using the transfer function coef¬ 
ficients ao, ai,... , a,v and 1, b\,... , b N . The realization can be accomplished by using a recursive 
algorithm comprising N iterations whereby polynomials of the form 

j j 

Nj(z) = D i& = E ft*”'’ 

i=o ;=o 

are generated for j = N, N — 1, ... , 0, and for each value of j the multiplier constants Vj and 
are evaluated using coefficients a ;; and /i /; in the above polynomials. The steps involved are 
detailed below. 

Step 1: Let Nj (z) = N(z ) and Dj(z) = D(z) and assume that j = N, that is 


j 

n n (z) = y ^Ujiz~ i 

i= 0 

j 

N 

= E aiz “' 

i=0 

N 


(8.7a) 

D N (z) = J2Pj‘ z ~‘ 

i= 0 

= E fo '^' 

/=o 

with bo = l 

(8.7b) 



(«) 



{b) 


Figure 8.9 (a) General lattice configuration, (b) jth lattice section. 
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Step 2: Obtain v j , fij , jV ; _i(z), and Dj _j(z) for j = N, N — 1, ... ,2 using the following recursive 
relations: 

v j = «jj I'i = Pjj 


l-J 


Pj(z) = Dj(-)z- j = J2Pjiz‘ 

7 z / i=o 

7-1 

Nj-l(z) = Nj(z) - VjPjiz) = J 2 °‘jiZ~ i 

z=0 

- p-jPjiz) _ y^p.. 


Dj- t(z) = 


iZ 


1 - ^ ,=0 

Step 3: Let j = 1 in Eqs. ( 8 . 8 a)-( 8 . 8 d) and obtain vi, /ii, and iVo(z) as follows: 

Vi = an Mi = /h i 

1 


( 8 . 8 a) 

( 8 . 8 b) 

( 8 . 8 c) 

( 8 . 8 d) 

(8.9a) 

(8.9b) 

(8.9c) 


Pl(z) = D 1 z " 1 = ySioZ - 1 + Pu 
No(z) = Ni(z) - viPi(z) = aoo 
Step 4: Complete the realization by letting 

vo = aoo 

The above lattice realization procedure is illustrated in the following example by obtaining a general 
second-order lattice structure. 


Example 8.3 


Realize the transfer function of Example 8.1 using the lattice method. 


■ Solution 

From Eqs. (8.7a) and (8.7b), we can write 

N 2 (z) — a 2 o + a 2 iz~' + a 22 z~ 2 = ao + aiz' 1 + a 2 z~ 2 
D 2 (z ) = /S 2 o + /S 2 1 z 1 + P 22 z~ 2 = 1 + biz -1 + b 2 z~ 2 
For j = 2, Eqs. (8.8a)-(8.8d) yield 

v 2 = a 22 — a 2 ft 2 = fi 22 = b 2 

P 2 (z) = D 2 ^ - j z~ 2 = z -2 + b\z~ l +b 2 = p 20 z~ 2 + Pn z _1 + P 22 
N\ (z) = N 2 (z) - v 2 P 2 (z) — a 0 + aiz -1 + a 2 z~ 2 - v 2 (z -2 + b\z~ l + b 2 ) 


-l 


D i(z) = 


= aio + anz“ 

D 2 (z) ~ Vi 2 P 2 {z) 1 + b\z~ x + b 2 z~ 2 - fi 2 (z~ 2 + biz -1 + b 2 ) 

1 - !i 2 2 


i - 14 
= i6io + /Siiz _1 
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where 


CHio — CIq — U 2 b 2 °hl = ^1 — 02^1 

b\ 


PlO =1 J01I = 


Similarly, from Eqs. (8.9a)-(8.9c), we have 


1 + b 2 


ui = an = ai - a 2 bi Mi = At = 


1 +b 2 

Pi(.z) = D l z - 1 = Pwz- 1 + p n 

No (z) = Ni(z) - vi Pi(z) = a io + u n z~ l - v x (P w z~ l + Pi 1) = «oo 


where 


«oo = («o - a 2 b 2 ) - 


(a l ~ aibi)bi 

l + b 2 


and from step 4, we have 


no = aoo 


Summarizing, the multiplier constants for a general second-order lattice realization are 
as follows: 


v 0 = (flo — Cllbl) — 

V! = fl! — Gobi 


(«i — a 2 b\)bi 

l + b~ 2 

v 2 — ®2 


Mi 


b i 

1+^2 


M2 = b 2 ■ 


The 2-multiplier section of Fig. 8.9 b yields structures that are canonic with respect to the 
number of unit delays. However, the number of multipliers can be quite large, as can be seen 
in Example 8.3. More economical realizations can be obtained by using 1 -multiplier first-order 
sections of the type shown in Fig. 8.10. Such realizations can be obtained by first realizing the 
transfer function in terms of 2-multiplier sections as described above and then replacing each of the 
2-multiplier sections by either of the 1-multiplier sections of Fig. 8.10. The denominator multiplier 
constants mi, m 2 , ■■■, Miv remain the same as before. However, the numerator multiplier constants 
vo, Vi, ..., vjv must be modified as 


tj = 


,n,w (1 + £ ;M;+i) 


where 


for j = N 

for j = 0, 1, ..., N - 1 
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(A) 



(b) 

Figure 8.10 1-multiplier section: (a) For case where e,- = +1, ( b ) for case where e ; = — 1. 

Each parameter e, is a constant which is equal to +1 or — 1 depending on whether the i th 2-multiplier 
section is replaced by the 1-multiplier section of Fig. 8.10a or that of Fig. 8.1 Ob. The choice between 
the two types of sections is, in theory, arbitrary; however, in practice, it can be used to improve the 
performance of the structure in some respect. For example, by choosing the types of sections such 
that the signal levels at the internal nodes of the filter are maximized, an improved signal-to-noise 
ratio can be achieved (see Ref. [4] and Chap. 14). 

8.2.5 Cascade Realization 

When the transfer function coefficients are quantized, errors are introduced in the amplitude and 
phase responses of the filter. It turns out that when a transfer function is realized directly in terms 
of a single A'th-ordcr network using any one of the methods described so far, the sensitivity of 
the structure to coefficient quantization increases rapidly with N. Consequently, small errors intro¬ 
duced by coefficient quantization give rise to large errors in the amplitude and phase responses. 
This problem can to some extent be overcome by realizing high-order filters as interconnections of 
first- and second-order networks. In this and the next section, it is shown that an arbitrary transfer 
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*lfe) Fife) X 2 (z) Y 2 (z) X m (z) Y m (z) 

(a) 



Figure 8.11 (a) Cascade realization of H(z), ( b ) canonic second-order section. 


function can be realized by connecting a number of first- and second-order structures in cascade 
or in parallel. Another approach to the reduction of coefficient quantization effects is to use the 
wave realization method, which is known to yield low-sensitivity structures. This possibility will be 
examined in Chap. 17. 

Consider an arbitrary number of filter sections connected in cascade as shown in Fig. 8.11a 
and assume that the ith section is characterized by 


Y,(z) = H i (z)X i (z) 


( 8 . 10 ) 


From Fig. 8.11a, we note that 

Y\ (z) = H\(z)X\(z) = H\(z)X(z) 

Y 2 (z ) = H 2 (z)X 2 (z) = H 2 (z)Y!(z) = H 1 (z)H 2 (z)X(z) 

Y 3 (z ) = H 3 (z)X 3 (z) = H 3 (z)Y 2 (z) = Hi(z)H 2 (z)H 3 (z)X(z) 


Y(z ) = V M (z) = H M (z)Y M - i(z) = H\(z)H 2 (z) ■ ■ ■ H m (z)X(z) 

Therefore, the overall transfer function of a cascade arrangement of filter sections is equal to the 
product of the individual transfer functions, that is, 

M 

H{z) = H,(z) 

i= 1 
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An /Vth-order transfer function can be factorized into a product of first- and second-order transfer 
functions of the form 


11,(7.) 


do i + a l iZ 
1 + bliZ~ l 


(8.11a) 


and 


11,(7.) = 


cioi + auz 1 + a 2 iZ ' 
1 + b u z~ l + b 2 jZ ~ 2 


(8.11b) 


respectively. Now the individual first- and second-order transfer functions can be realized using any 
one of the methods described so far. Connecting the filter sections obtained in cascade would realize 
the required transfer function. For example, one could use the canonic section of Fig. 8.life with 
d 2 i = bij — 0 for a first-order transfer function to obtain a cascade canonic realization. 


Example 8.4 


Obtain a cascade realization of the transfer function 

x 216z 3 + 96z 2 + 24z 
H(z) = 


(2z+ l)(12z 2 + 7z+ 1) 

using canonic sections. 

■ Solution 

The transfer function can be expressed as 




z+i z' + nz + i; 


= 9 x 


1 + jZ -1 


1 + fz- 1 + |z~ 2 
l + ^z-'-F ^- 2 


Hence, the cascade canonic realization shown in Fig. 8.12 can be readily obtained. 


X(Z) 



> Y)z) 


Figure 8.12 Cascade realization of H(z) (Example 8.4). 
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8.2.6 Parallel Realization 

Another realization comprising first- and second-order filter sections is based on the parallel config¬ 
uration of Fig. 8.13. Assuming that the ;th section in Fig. 8.13 can be represented by Eq. (8.10) and 
noting that X\ (z) = X 2 {z) = ■ ■ • = X M (z) — X(z), we can write 

Y(z)= Y t (z)+Y 2 (z)+--- + Y M (z) 

= Hi(z)Xi(z) + H 2 (z)X 2 (z) + ■ ■ ■ + H m (z)X m (z) 

= H t (z)X(z) + H 2 (z)X(z) + ■ ■ ■ + H„(z)X(z) 

= lHdz ) + H 2 (z) + • ■ ■ + H m (z)\X(z) 

= H(z)X(z) 


where 

M 

H(z) = J2 Hiiz) 

i=i 

Through the use of partial fractions, an /V-order transfer function //(-) can be expressed 
as a sum of first- and second-order transfer functions just like those in Eqs. (8.11a) and (8.11b). 
Connecting the sections obtained in parallel as in Fig. 8.13 would result in a parallel realization. 

An alternative parallel realization can be readily obtained by expanding H(z)/z instead of 
IKz) into partial fractions. 



Figure 8.13 Parallel realization of H(z). 
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Example 8.5 


Obtain a parallel realization of the transfer function 
10z 4 — 3.7z 3 — 1.28z 2 + 0.99z 

H(z) = 


(z 2 + z + 0.34)(z 2 + 0.9z + 0.2) 

using canonic sections. 

■ Solution 

We first need to find the poles of the transfer function. We have 

10z 4 -3.7z 3 - 1.28z 2 + 0.99z 

H{z) = 


(z - pi)(z - pi){z - Pi)(z - pa) 


where 

Pi, Pi = 0-5 + JO.3 
Pi = -0.4 
Pa = -0.5 

If we expand H(z)/z into partial fractions, we get 
H(z) Ri , R 2 


+ 


Ri 


Ra 


z z — 0.5 + y'0.3 z — 0.5 — y'0.3 z + 0.4 z + 0.5 
The /th residue of H(z)/z is given by 

(z - Pi)H(z) 


Ri = 


7 -=Pi 


and through routine arithmetic or through the use of MATLAB, we get 

(10z 4 -3.7z 3 - 1.28z 2 + 0.99z) 


R i = 


z(z - pi){z - Pi)(z - Pa) 
(10z 3 -3.7z 2 - 1.28z + 0.99) 


Z=P 1 


(z - Pi)(z - Pi)(z - Pa) 


= 1.0 


Similarly, 


Ri — 1 Ri — 3 Ra = 5 


and thus 


H(z) = 


+ 


3z 


5z 


z — 0.5 + y'0.3 z — 0.5 — y'0.3 z + 0.4 z + 0.5 
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Figure 8.14 Parallel realization of H(z) (Example 8.5). 


Now, if we combine the first two and the last two partial fractions into second-order 
transfer functions, we get 

„. . 2 z 2 - z 8 z 2 + 3.5z 

H(z) = 


or 


where 


z 2 -z + 0.34 z 2 + 0.9 z + 0.2 
H(z) = H](z) + H 2 (z ) 


Hi(z) = 


2 - z 


-l 


and H 2 (z) = 


8 + 3.5z 


-l 


1-z- 1 +0.34Z- 2 1 + 0.9z-' + 0.2z-2 

Using canonic sections, the parallel realization shown in Fig. 8.14 can be obtained. 
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1 2 J 



1 2 J 


Transpose 


1 2 K 


Figure 8.15 Transposition. 


8.2.7 Transposition 

Given a signal flow graph with inputs j = 1, 2,..., /and outputs & = 1, 2,..., K, a corresponding 
signal flow graph can be derived by reversing the direction in each and every branch such that the 
/ input nodes become output nodes and the K output nodes become input nodes, as illustrated in 
Fig. 8.15. The signal flow graph so derived, is said to be the transpose (or adjoint) of the original 
signal flow graph [9] (see also Chap. 4 of Ref. [10]). An interesting property of transposition is 
summarized in terms of the following theorem. 

Theorem 8.1 Transposition If a signal flow graph and its transpose are characterized by 
transfer functions Hjkiz) and IIkj (z .), respectively, then 


Hjk(z) = Ihj(z) 

Proof See Ref. [9] or [10] for the proof. ▲ 


The transposition property can be used as a tool in the realization process since given an 
arbitrary digital network obtain through anyone of the realization procedures described in this chapter, 
an alternative realization can be derived through transposition. 


Example 8.6 


Obtain the transpose of the canonic network of Fig. 8.16 a. 


■ Solution 

The signal flow graph of the canonic section of Fig. 8.16a can be readily obtained as 
shown in Fig. 8.16£>. The transpose of the signal flow graph is shown in Fig. 8.16c and 
the transpose network is shown in Fig. 8.16/. ■ 
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x(nT) 



«0 



y(n) 


ao 



x'(n) 


(c) 



/(«) 


Figure 8.16 Transpose realization (Example 8.6): (a) Original realization, ( b ) signal flow 
graph of original realization, (c) transpose signal flow graph, ( d ) transpose realization. 
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8.3 IMPLEMENTATION 

As was stated in Sec. 1.8, the implementation of digital filters can assume two forms, namely, software 
and hardware. This classification is somewhat artificial, however, since software and hardware are 
highly interchangeable nowadays. In nonreal-time applications, usually speed is not of considerable 
importance and the implementation might assume the form of a computer program on a general- 
purpose computer or DSP chip, which will emulate the operation of the digital filter. Such an 
implementation would be based on the difference equations characterizing one of the digital-filter 
structures described in the previous sections. On the other hand, if a digital filter is to be used 
in some communications system, speed is of the essence and the implementation would assume 
the form of a dedicated, highly specialized, piece of hardware. Depending on the application, a 
hardware implementation may comprise one or several interconnected VLSI circuit chips depending 
on the complexity of the required digital filter. Progress continues to be made in this technology in 
accordance with Moore’s Law and as more and more functions can be accommodated on a VLSI 
chip, on the one hand, more complicated digital filters can be accommodated on a single chip and, 
on the other, fewer chips are needed to implement digital filters of high complexity. 

8.3.1 Design Considerations 

In practice, fabrication costs may be classified as recurring, e.g., the cost of parts, and nonrecurring, 
e.g., the design costs. For special-purpose systems like digital filters, demand is usually relatively 
small. Consequently, the design costs predominate over other costs and should be kept as low as 
possible. If the realization of the digital filter can be decomposed into a few types of basic building 
blocks that can be simply interconnected repetitively in a highly regular fashion, considerable savings 
in the design costs can be achieved. The reason is that the few types of building blocks need to be 
designed only once. A modular design of this type offers another advantage which can lead to cost 
reductions. By simply varying the number of modules used in a chip, a large selection of different 
digital filters can be easily designed that meet a variety of performance criteria or specifications. In 
this way, the nonrecurring design costs can be spread over a larger number of units fabricated and, 
therefore, the cost per unit can be reduced. 

In certain real-time applications, high-order filters are required to operate at very high sampling 
rates. In such applications, a very large amount of computation needs to be carried out during each 
sampling period and the implementation must be very fast. While progress continues to be made 
in increasing the speed of gates and reducing the propagation delays by reducing the lengths of 
interconnection wires, progress is slowing down in these areas and the returns are slowly diminishing. 
Therefore, any major improvement in the speed of computation must of necessity be achieved through 
the concurrent use of many processing elements. It turns out that the degree of concurrency is an 
underlying property of the digital-filter realization. For example, realizations that comprise parallel 
substructures allow a high degree of concurrency and, therefore, lead to fast implementations. When a 
large number of processing elements must operate simultaneously, communication among processing 
elements becomes critical. Since the cost, performance, and speed of the chip depend heavily on the 
delay and area of the interconnection network, a high degree of concurrency should be achieved in 
conjunction with simple, short, and regular communication paths among processing elements. 

8.3.2 Systolic Implementations 

VLSI chip designers have been well aware of the merits of simplicity of form, regularity, and 
concurrency for a number of years and have developed special VLSI structures that offer many of 
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these advantages. A family of such structures is the family of systolic arrays which are highly regular 
VLSI networks of simply connected processing elements that rhythmically process and pass data 
from one element to the next [11, 12]. The operation of these arrays is analogous to the rhythmical 
systolic operation of the heart and arteries by which blood is pumped forward from one artery to the 
next. Evidently, systolic realizations satisfy the design requirements alluded to earlier and are, as a 
consequence, highly suitable for the implementation of digital filters. 

Close examination of the types of structures considered so far reveals that most of them are 
not suitable for systolic implementation. However, some of them can be made suitable by simple 
modifications, as will be demonstrated below. A useful technique in this process is known as pipelin¬ 
ing. In this technique, the computation is partitioned into smaller parcels that can be assigned to a 
series of different concurrent processing elements in such a way as to achieve a speed advantage. A 
pipeline in the present context is, in a way, analogous to a modern assembly line of cars whereby the 
task of building a car is partitioned into a set of small subtasks carried out by concurrent workers (or 
robots) working at different stations along the assembly line. Pipelining will introduce some delay 
in the system, but once the pipeline is filled, a car will roll off the assembly line every few minutes. 
This sort of efficiency cannot be achieved by having all the workers working concurrently on one 
car for obvious reasons. 

Consider the realization of 


N 

y(nT) = E aixinT — iT ) 

;=o 

shown in Fig. 8.17a, and assume that each addition and multiplication can be performed in x a and 
r„, seconds, respectively. This structure can be readily obtained from Fig. 8.4<r/. Processing elements 
can be readily identified, as illustrated by the dashed lines. The additional unit delay at the right and 
the adder at the left with zero input are used as place holders in order to improve the regularity of the 
structure; they serve no other purpose. A basic disadvantage associated with this implementation is 
that the processing rate, which is the maximum sampling rate allowed by the structure, is limited. The 
processing rate of an implementation is the reciprocal of the time taken to perform all the required 
arithmetic operations between two successive samples. While the multiplications in Fig. 8.17a can 
be carried out concurrently, the N + 1 additions must be carried out sequentially from left to right. 
Therefore, a processing time of r,„ + (N + l)r a seconds is required, which can be large in practice 
since N can be large. 

The processing rate in the structure of Fig. 8.17a can be increased by using faster adders. A 
more efficient approach, however, is to increase the degree of concurrency through the application 
of pipelining. Consider the possibility of adding unit delays between processing elements, as de¬ 
picted in Fig. 8.17£>. Since the top and bottom outputs of each processing element are delayed by 
the same amount by the additional unit delays, the two signals are not shifted relative to each other, 
and the operation of the structure is not destroyed. The only effect is that the overall output will be 
delayed by NT seconds, since there are N additional delays between processing elements. Indeed, 
straightforward analysis gives the output of the modified structure as 

N 

y p (nT) = E a,x(nT — iT — NT) 
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(a) 



(b) 



(c) 


Figure 8.17 ( a ) Realization of Mh-order nonrecursive filter, ( b ) corresponding systolic realization, 

(c) typical processing element. 


that is, 


y p (nT) = y(nT — NT) 


where y(nT) is the output of the original structure. The delay NT is said to be the latency of the 
structure. In the modified structure, only one multiplication and one addition is required per digital- 
filter cycle and, therefore, the processing rate is l/(r m + r a ). In effect, the processing rate does not, 
in this case, decrease as the value of N is increased. The additional unit delays in Fig. 8.176 may be 
absorbed into the processing elements, as depicted in Fig. 8.17c. 

An alternative structure that is amenable to a systolic implementation is depicted in Fig. 8.18«. 
This is obtained from the structure of Fig. 8.46. As can be seen, only one multiplication and one 
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Figure 8.18 (a) Alternative realization of Ath-order nonrecursive filter, (b) corresponding systolic realization. 
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addition are required per digital-filter cycle, and so the processing rate is l/(r m + r a ). The basic 
disadvantage of this structure is that the input signal has to be communicated directly to all the 
processing elements simultaneously. Consequently, for large values of N, wires become long and 
the associated propagation delays are large, thereby imposing an upper limit on the sampling rate. 
The problem can be easily overcome by using padding delays, as in Fig. 8.18£>. 


Example 8.7 


A DSP chip that realizes the nonrecursive filter shown in Fig. 8.19 is readily 
available as an off-the-shelf component. The chip is fitted with registers for coefficients mo to 
mo, which can accommodate arbitrary multiplier constants. Realize the transfer function 


H(z) = 


216tr + 96tr + 24; + 2 
(2z+ l)(12z 2 + 7-+ 1) 


using two of these DSP chips along with any necessary interfacing devices. 


■ Solution 


The transfer function can be expressed as 


H(z) = 


Y(z ) 
X(z) 




-3 


-3 


or as 


Y(z) = 


N(z ) 

1 + D'(z) 


X(z) 


where 


N(z) = 9 + 4z 1 + z 2 + -j \z 3 
D\z) = f A z~ l + lz~ 2 + ^z~ 3 


Hence 


Y(z) = N(z)X(z) - Y(z)D'(z ) 

This equation can be realized using two nonrecursive filters with transfer functions N(z) 
and — D'(z ) as shown in Fig. 8.1. N(z) can be realized by the structure in Fig. 8.19 
if mo = 9, m\ = 4, mi = 1, m3 = 1/12. On the other hand, — D'(z ) can be re¬ 
alized by the structure in Fig. 8.19 if mo = 0, mi = —26/24, m 2 = —9/24, and 
m 3 = —1/24. ■ 
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Figure 8.19 (a) Nonrecursive filter (Example 8.7). 
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PROBLEMS 

8.1. (a) Obtain the signal flow graph of the digital filter shown in Fig. P8.1. 

( b ) Deduce the transfer function of the filter using the node elimination method. 
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8.2. (a) The flow graph of Fig. P8.2o represents a recursive filter. Deduce the transfer function. 
( b ) Repeat part (a) for the flow graph of Fig. P8.2 b. 



Y(z) 


Figure P8.2a 



Figure P8.26 
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8.3. (a) Convert the flow graph of Fig. P8.3 into a topologically equivalent network. 
( b ) Obtain an alternative realization by using the direct canonic method. 



-1 1 1 


Figure P8.3 

8.4. (a) Derive flow-graph representations for the filter of Fig. 8.5 b. 

( b ) Repeat part (a) for the filter of Fig. 8.14. 

8.5. A flow graph is said to be computable if there are no closed delay-free loops (see Sec. 4.8.1). 

(a) Check the flow graphs of Fig. P8.5a for computability. 

( b ) Repeat part ( a ) for the filter of Fig. P8.5£>. 



Figure P8.5a 


11 2 1 



Figure P8.56 
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8.6. By using first the direct and then the direct canonic method, realize the following transfer functions: 


(a) H{z) ~ 


4(z - l) 4 


C b) H(z ) = 


(z + l) 2 


4z 4 + 3z 3 + 2z 2 + z + 1 4z 3 - 2z 2 + 1 

8.7. A digital filter is characterized by the state-space equations 

q(nT + T) — Aq (nT) + bx(nT) 
y(nT) = c r q (nT) + dx(nT) 

where 


A = 


0 


1 

-1 


b = 


= [-?*] 


(a) Obtain a state-space realization. 

(b) Obtain a corresponding direct canonic realization. 

(c) Compare the realizations in parts (a) and ( b). 

8.8. Repeat Prob. 8.7 if 


A = 


'-0.1 -0.5' 


0.7 

T 

8.8' 

1.1 -0.2 

b = 

2.0 

C = 

-0.6 


d = 2 


d = 8.0 


8.9. Repeat Prob. 8.7 if 



r° 

1 

°1 


'O' 

A = 

0 

0 

1 

b = 

0 


25 

29 

3 


1 


-64 

32 

4- 



8.10. (a) Realize the transfer function 


C T _ [25 2. ill 
L 64 32 4 J 


u / , Z(Z + 1) 

HiZ)= -2 — f ^ _L 1 


z 2 -^z+i 


using a lattice structure. 

( b ) Repeat part (a) for the transfer function 


d = 1 


H{z) = 


z + 2z + 1 
z 2 + 0.5z + 0.3 


8.11. Realize the transfer function 


H(z) = 


0.0154z 3 + 0.0462z 2 + 0.0462z + 0.0154 


z 3 - 1.990z 2 + 1.572z - 0.4582 

using the lattice method. 

8.12. A recursive digital filter is characterized by the state-space equations in Prob. 8.7 with 



r o 

l 

0 1 


'O' 

A = 

0 

i 

- 2 

0 

—m 

1 

—2 

b = 

0 

1 


= [ 12 - 1 ] 


d = 1 


(a) Determine the range of m for which the filter is stable. 

( b ) Obtain a state-space realization for the filter. 
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(c) Obtain a lattice realization. 

(d) Compare the realizations in parts (b) and (c). 
8.13. (a) Realize the transfer function 

H(z) = 


6 z 


(6 z 3 + 6 z 2 + 3z)(3z — 1) 


using direct canonic sections in cascade. 

( b ) Repeat part (a) using direct canonic sections in parallel. 
8.14. (a) Realize the transfer function 


H{z) = 


216z 3 + 168z 2 + 48z 
24 (z + ±)(z 2 + 


using low-order direct canonic sections in cascade. 

( b ) Repeat part (a) using direct canonic sections in parallel. 
8.15. (a) Obtain a cascade realization for the transfer function 


H(z) = 


4(z - l)(z + l) 2 
(2z + l)(2z 2 — 2z + 1) 


using canonic sections. 

( b ) Obtain a parallel realization of the transfer function in part (a) using canonic sections. 
8.16. (a) Obtain a cascade realization for the transfer function 


H(z) = 


12z 3 + 6.4z 2 + 0.68z 
(z + 0.1 )(z 2 + 0.8z + 0.15) 


using canonic sections. 

( b) Obtain a parallel realization of the transfer function in part (a) using canonic sections. 
8.17. (a) Obtain a realization of the transfer function 


H{z) = 


96z 2 - 72z + 13 
24(z - i)(z - i)(z - i) 


using a canonic first-order and a canonic second-order section in cascade. 

(, b ) Obtain a parallel realization of the transfer function in part (a) using canonic first-order sections. 
8.18. (a) Realize the transfer function 


H (z) = 


16(z + l)z 2 


(4z + 3)(4z 2 - 2z + 1) 


using canonic sections in cascade. 

(b) Repeat part (a) using canonic sections in parallel. 

8.19. First-order filter sections of the type depicted in Fig. P8.19 are available. Using sections of this type, 
obtain a parallel realization of the transfer function 


H{z) = 


216z 2 + 162z + 29 
(2z+ l)(3z+ l)(4z+ 1) 
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Figure P8.19 

8.20. (a) Construct a flow chart for the software implementation of an IV-section cascade filter assuming 

second-order filter sections. 

( b ) Write a computer program that will emulate the cascade filter in part (a). 

8.21. (o) Construct a flow chart for the software implementation of an IV-section parallel filter assuming 

second-order filter sections. 

(, b ) Write a computer program that will emulate the parallel filter in part (a). 

8.22. (a) Construct a flow chart for the software implementation of an fVth-order state-space filter. 

( b ) Write a computer program that will emulate the state-space filter of part (a). 

8.23. (a) Construct a flow chart for the software implementation of an 2nd-order lattice filter. 

(, b ) Write a computer program that will emulate the lattice filter of part (a). 

8.24. (a) Obtain the transpose of the network of Fig. 5.2. 

(b) Repeat part (a) for the network of Fig. 5.11. 

8.25. (o) Obtain the transpose of the network shown in Fig. 8.5 b. 

(, b) Repeat part (a) for the network of Fig. 8.14. 

8.26. A digital-filter network that has a constant gain at all frequencies is said to be an allpass network. 

(a) Show that the network depicted in Fig. P8.26 is an allpass network. 

( b ) Obtain an alternative allpass network using transposition. 

(c) Show that the transpose network has the same transfer function as the original network. 



Figure P8.26 
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8.27. DSP VLSI chips that realize the module shown in Fig. P8.27a and the adder shown in Fig. P8.27fo 
are readily available as off-the-shelf components. The chip in Fig. P8.27« is fitted with a register for 
coefficient a k , which can accommodate an arbitrary multiplier constant. Using as many chips as necessary 
of the type shown in Fig. P8.27a plus an adder of the type shown in Fig. P8.27&, realize the transfer 
function 


H(z) = 


lAz 2 — 2.2z + 1.1 
z 2 - 0.4z + 0.3 




(b) 


8.28. Realize the transfer function 


H(z) = 


: - h + 4 


— \z“ + \z + 


1 

8 


using the VLSI chip of Prob. 8.27. 

8.29. A DSP chip that realizes the nonrecursive filter shown in Fig. P8.29a is readily available as an off-the-shelf 
component. The chip is fitted with registers for coefficients mo to m 3 , which can accommodate arbitrary 
multiplier constants. Realize the transfer function 


216z 3 + 96z 2 + 24z + 2 
{2z+ l)(12z 2 + 7z+ 1) 


using two of these chips along with a 2-input adder such as that in Fig. P8.29 b. 
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(b) 


Figure P8.29 

8.30. A DSP chip that realizes the recursive filter shown in Fig. 8.16 d is readily available as an off-the-shelf 
component. The chip is fitted with registers that can accommodate the coefficients ao, a\, 02 , b 1 , and b 2 - 
Realize the transfer function 


_ 48(z + 0.138)(z 2 + 0-312z + 0.0694) 

(2z+l)(12z 2 + 7z+1) 

using exactly two of these DSP chips, i.e., no other types of components are available. Show the config¬ 
uration chosen and give suitable values to the various coefficients. 












CHAPTER 

9 


DESIGN OF 
NONRECURSIVE 
(FIR) FILTERS 


9.1 INTRODUCTION 

The preceding chapter has dealt with the realization of digital filters whereby given an arbitrary 
transfer function or state-space characterization, a digital-filter network or structure is deduced. This 
and several of the subsequent chapters will deal with the approximation process whereby given some 
desirable filter characteristics or specifications, a suitable transfer function is derived. 

As was mentioned in the introduction of Chap. 8, approximation methods can be classified 
as direct or indirect. In direct methods the discrete-time transfer function is generated directly in 
the z domain whereas in indirect methods it is derived from a continuous-time transfer function. 
Approximations can also be classified as noniterative or iterative. The former usually entail a set 
of formulas and transformations that yield designs of high precision with minimal computational 
effort. Iterative methods, on the other hand, are based on optimization algorithms. In these methods 
an initial design is assumed and is progressively improved until a discrete-time transfer function 
is obtained that satisfies the prerequisite specifications. These methods are very versatile and can, 
therefore, be used to obtain solutions to problems that are intractable with noniterative methods 
although they usually require a large amount of computation. 

Approximation methods for the design of nonrecursive filters differ quite significantly from 
those used for the design of recursive filters. The basic reason for this is that in nonrecursive filters 
the transfer function is a polynomial in z _1 whereas in recursive filters it is ratio of polynomials in z. 
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Nonrecursive filters are designed by using direct noniterative or iterative methods whereas recursive 
filters are designed by using indirect noniterative methods or direct iterative methods. 

The approximation problem for nonrecursive filters can be solved by applying the Fourier series 
or through the use of numerical analysis formulas. These methods provide closed-form solutions and, 
as a result, they are easy to apply and involve only a minimal amount of computation. Unfortunately, 
the designs obtained are suboptimal with respect to filter complexity whereby a filter design is said 
to be optimal if the filter order is the lowest that can be achieved for the required specifications. 
Another approach to the design of nonrecursive filters is to use a powerful multivariable optimization 
algorithm known as the Remez exchange algorithm as will be shown in Chap. 15. The Remez approach 
yields optimal designs but, unfortunately, a huge amount of computation is required to complete a 
design, which renders the approach unsuitable for applications where nonrecursive filters have to be 
designed in real or quasi-real time. 

This chapter begins by examining the basic properties of nonrecursive filters. Then the use of the 
Fourier series as a tool in the design of nonrecursive filters is examined. It turns out that the use of the 
Fourier series by itself does not yield good designs but by applying the window technique described 
in Sec. 7.8 in conjunction with the Fourier series some moderately successful approximations can be 
obtained. The chapter concludes with the application of some classical numerical analysis formulas 
for the design of nonrecursive filters that can perform numerical interpolation, differentiation, or 
integration. 

9.2 PROPERTIES OF CONSTANT-DELAY 
NONRECURSIVE FILTERS 

Nonrecursive filters can be designed to have linear or nonlinear phase responses. However, linear- 
phase designs are typically preferred. In this section, it is shown that linear phase (or constant delay) 
can be achieved by ensuring that the impulse response has certain symmetries about its center point. 
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For constant phase and group delays, the phase response must be linear, i.e., 

9{w) = —rw 


and thus from Eqs. (9.2) and (9.3), we have 


Consequently, 


9(w) — — rw = tan' 


- E,to* h(nT) sin wnT 
J2n=o h(nT)cosconT 


J2n=o h ( n T ) s i n wn T 
J2n=o h(n T) cos om T 


and accordingly 


N -1 

^/i(h7’)(coswh7’ sin&ir — sin&>«r cos&nr) = 0 

n =0 


N—l 

or ^ h(nT ) sin(tt>r — wnT) = 0 

n =0 

The solution of this equation is 

(N - 1 )T 

r = - 

2 

h{nT) = h[(N — 1 — n)T] for 0 < n < N — \ 


(9.4a) 

(9.4b) 


as can be easily verified. Therefore, a nonrecursive filter can have constant phase and group delays 
over the entire baseband. It is only necessary for the impulse response to be symmetrical about the 
midpoint between samples (N — 2)/2 and N/2 for even N or about sample (N — l)/2 for odd N. 
The required symmetry is illustrated in Fig. 9.1 for N — 10 and 11. 

In contrast, recursive filters with constant phase or group delay are not easy to design as will 
be found out in Chaps. 11 and 12. 

In most applications only the group delay needs to be constant in which case the phase response 
can have the form 


0(w) = 9 q — rw 


where 9q is a constant. On assuming that 9q = ±n/2, the above procedure yields a second class of 
constant-delay nonrecursive filters where 


(N - 1 )T 

r = - 

2 

h(nT ) = -h[(N - 1 - n)T] 


(9.5a) 

(9.5b) 


In this case, the impulse response is antisymmetrical about the midpoint between samples (N — 2)/2 
and N/2 for even N or about sample (N — l)/2 for odd N, as illustrated in Fig. 9.2. 
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1.0 


h(nT) 


- 1.0 *- 




Center of symmetry 


N= 10 


' I j >‘ T 

nT=9T 


(a) 



Figure 9.1 Impulse response for constant phase and group delays: (a) Even N, ( b ) odd N. 


9 . 2.2 Frequency Response 

The symmetries in the impulse response in Eqs. (9.4b) and (9.5b) lead to some simple expressions 
for the frequency response of nonrecursive filters as will now be demonstrated. For a symmetrical 
impulse response with N odd, Eq. (9.2) can be expressed as 


(tv—3)/2 

H(e J0,r ) = Y h(nT)e~ jwnT 

n =0 


(.N - 1 )T 


e -MN-l)T/2 + 


tv -1 

h(nT)e~ i<onT 
;i=(tV+l)/2 


(9.6) 


By using Eq. (9.4b) and then letting N — l — n = m and m — n, the last summation in Eq. (9.6) can 
be expressed as 


IV—1 IV—1 

Y h(nT)e~ j(onT = Y h[(N - l - n)T)e- ja>nT 

«=(tV+l)/2 n=(N+ 1)/2 

(tV—3)/2 

= Y h{nT)e- ja,( ' N - 1 ~ n)T 

n =0 


(9.7) 
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Figure 9.2 Alternative impulse response for constant group delay: (a) Even N, ( b ) odd N. 


Now from Eqs. (9.6) and (9.7) 


H(e^ T ) = e —M*—D 272 I h 


(n - i)r 


(N- 3)/2 


Y 2 h(nT)i 


n =0 


N — 1 

<y I —i- n | T 


and with (N — l)/2 — n — k, we have 

(JV—1)/2 

//(e> r ) = e - ja * N - 1)T ' 2 E ak cos cokT 

k =0 


where 


«o = h 


ak = 2 h 


(N - i)r 
2 

N — l 


— k \ T 


(9.8a) 


(9.8b) 


Similarly, the frequency responses for the case of symmetrical impulse response with N 
even and for the two cases of antisymmetrical response simplify to the expressions summarized in 
Table 9.1. 
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Table 9.1 Frequency response of constant-delay nonrecursive filters 


h(nT) N 

H(e juT ) 

Symmetrical Odd 

e -jio(N-V)T/2 J2[ n = ~ 1)/2 a k cos wkT 

Even 

e -joj( N -\yri2 bk cos[w (jt _ 1)7] 

Antisymmetrical Odd 

e -jMN-i)T/2-n/2\ Y^ m a k sin wkT 

Even 

e -j[w(.N-l)T/2-x/2] b k sin [co(k - \)T] 

where a 0 = h [ (Ar ~ 1)7 ~] 

a k = 2 h [(^ - k) T] b k = 2h [(f - k) T] 


9.2.3 Location of Zeros 

The impulse response constraints of Eqs. (9.4) and (9.5) impose certain restrictions on the zeros of 
H(z). For odd N, Eqs. (9.1), (9.4b), and (9.5b) yield 


H(z) = 


1 


r (N—3)/2 


1 


z (.N-l)/2 


Y KnT){z (N - l)l2 ~ n ± z -K^-D/2-l) + t h 

n =0 2 


(N - 1 )T 


(z°±z°) 


(9.9) 


where the negative sign applies to the case of antisymmetrical impulse response. With (N — 1 )/2 —n — 
k, Eq. (9.9) can be put in the form 


H(z) = 


N(z ) 
D(z) 


, (tv-D/2 

1 V ?*(z*±Z-*) 

Z (N- 1)/2 2 

k =0 


where «o and a k are given by Eqs. (9.8a) and (9.8b). 
The zeros of II(z) are the roots of 


(N- 1)/2 

N{z)= Y a k(z k ±z~ k ) 

k =0 

If z is replaced by z _1 in N(z), we have 

(ZV-D/2 

N(z~')= Y a ^~ k ±z k ) 

k =0 

(N-l)/2 

= ± Y ak(z k ±z~ k ) = ±N(z ) 

k =0 
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Figure 9.3 Typical zero-pole plot for a constant-delay nonrecursive filter. 

The same relation holds for even N, as can be easily shown, and therefore if Zi = is a zero of 

H(z), then z.J 1 = e~^‘ /r,- must also be a zero of H(z). This has the following implications on the 
zero locations: 

1. An arbitrary number of zeros can be located at Zi = ±1 since zj -1 = ±1. 

2. An arbitrary number of complex-conjugate pairs of zeros can be located on the unit circle since 

(z - Zi)(z - z*) =(z- e jf, )(z - = (z- (z- ^ 

3. Real zeros off the unit circle must occur in reciprocal pairs. 

4. Complex zeros off the unit circle must occur in groups of four, namely, Zi, z*, and their recip¬ 
rocals. 

Polynomials with the above properties are often called mirror-image polynomials. A typical 
zero-pole plot for a constant-delay nonrecursive filter is shown in Fig. 9.3. 

9.3 DESIGN USING THE FOURIER SERIES 

Since the frequency response of a nonrecursive filter is a periodic function of a> with period co s , it 
can be expressed as a Fourier series (see Sec. 2.2). We can write 


OO 



H(e j0/r ) = 

h(nT)e~ j(onT 

(9.10) 

where 

h(nT ) = 

| r<o,/2 

— / H(e jroT )e jamT doj 

J- <o s /2 

(9.11) 


and co s = 2 ti/T. In Chap. 2, the Fourier series was applied for the time-domain representation of 
signals but in the present application it is applied for the frequency-domain representation of filters. 






432 DIGITAL SIGNAL PROCESSING 


In effect, the roles of time and frequency are interchanged. If we let e^ T = z in Eq. (9.10) 1 , we 
obtain 

OO 

H(z)= Y h(nT)z~ n (9.12) 

fl— — OO 

Hence with an analytic representation for a required frequency response available, a corresponding 
transfer function can be readily derived. Unfortunately, however, this is noncausal and of infinite 
order since h(nT ) is defined over the range —oo < n < oo according to Eq. (9.12). In order to 
achieve a finite-order transfer function, the series in Eq. (9.12) can be truncated by assigning 

N - 1 

h(nT) = 0 for \n\ > ——— 

in which case 

(N- 1)/2 

H(z) = h( 0)+ Y [h(~nT)z n + h(nT)z~ n ] (9.13) 

n= 1 

Causality can be brought about by delaying the impulse response by (N — I )T /2 s, which 
translates into multiplying H(z) by 11/2 by virtue of the time-shifting theorem of the z transform 
(Theorem 3.4), so that 

H\z) = z- (N ~ m H{z) (9.14) 

Since |z -(iv-1, / 2 | = 1 if z = e Ja>T , the above modification does not change the amplitude response 
of the derived filter. 

Note that if H(e-' loT ) in Eq. (9.10) is an even function of &>, then the impulse response obtained 
is symmetrical about n = 0, and hence the filter has zero group delay. Consequently, the filter 
represented by the transfer function of Eq. (9.14) has constant group delay equal to (N — I )T /2. 
The design approach just described is illustrated by the following example. 


Example 9.1 


Design a lowpass filter with a frequency response 
H(e'° yl ) 


'o 


for \a>\ < co c 

for a> c < |a>| < a> s /2 


where a> s is the sampling frequency. 

■ Solution 

From Eq. (9.11) 

1 


h(nT) = — / e i0>nT d(D= — 


JvnT 


jnT 


l ( ( e jo) c nT _ e -jco c nT^ 


nit 


2 j 


= — sin oj r n T 
nn 


1 This substitution is allowed by virtue of analytic continuation (see Sec. A.8). 
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Figure 9.4 Amplitude response of lowpass filter (Example 9.1). 

Hence Eqs. (9.13) and (9.14) yield 

(JV-l)/2 

H{z) = z -^-m £ !<*» + *-) . 

n= 0 

where ao = h( 0) a n = 2h(nT) 


The amplitude response of the lowpass filter obtained in Example 9.1 with a> c and w s assumed 
to be 4 and 20 rad/s, respectively, is plotted in Fig. 9.4 for N = 11 and 41. The passband and 
stopband oscillations observed are due to slow convergence in the Fourier series, which in turn, 
is caused by the discontinuity at a> c = 4 rad/s. These are known as Gibbs’ oscillations. As N is 
increased, the frequency of these oscillations is seen to increase, and at both low and high frequencies 
their amplitude is decreased. Also the transition between passband and stopband becomes steeper. 
However, the amplitudes of the passband and stopband ripples closest to the passband edge remain 
virtually unchanged as can be see in Fig. 9.4. Consequently, the quality of the filter obtained is not 
very good and ways must be found for the reduction of Gibbs’ oscillations. 

A rudimentary method is to avoid discontinuities in the idealized frequency response by in¬ 
troducing transition bands between passbands and stopbands [1], For example, the response of the 
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above lowpass filter could be redefined as 


H(e jaT ) 


1 


00 - (0 a 
C0 a - OO p 
0 


for | a; | < co p 
for co p < \co\ < co a 

for co a < \co\ < oo s /2 


9.4 USE OF WINDOW FUNCTIONS 

An alternative and easy-to-apply technique for the reduction of Gibbs’ oscillations is to truncate 
the infinite-duration impulse response h(nT) given by Eq. (9.11) through the use of a discrete-time 
window function w{nT) such as those encountered in Sec. 7.8.2. If we let 

h w (nT ) = w(nT)h(nT) 

then the complex-convolution theorem (Theorem 3.10) gives 

HJz) = Z[w(nT)h{nT )] = — I H(v)W {-) v~ l dv (9.15) 

2nj J r \ v / 

where T represents a contour in the common region of convergence of !l(v) and W(z/v) and 


OO 


H(z) = Zh(nT) = h(nT)z~ n 

n=—oo 

(9.16a) 

OO 

W(z) = Zw(nT) = w(nT)z ~" 

(9.16b) 


n=—o o 


If we let 


v — e jmT and z = e jloT 

and assume that H(v) and W(z/v) converge on the unit circle of the v plane, Eq. (9.15) can be 
expressed as 


H w (e^ T ) = 


T 

2jt 



H(e jnTT )W(e j(a, - m)T )dzu 


(9.17) 


This is, of course, a convolution integral like the one in Eq. (7.20) and the effect of the window 
spectrum on the frequency response of the nonrecursive filter is very much analogous to the effect 
of the frequency spectrum of a nonperiodic continuous-time window on the frequency spectrum of 
the truncated continuous-time signal in Sec. 7.8.1. 

Assuming that a lowpass filter with an idealized frequency response 


1 for 0 < \co\ < oo c 
0 for co c < \a>\ < oo s /2 


H{e jmT ) = 
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is required, the graphical construction for the convolution integral assumes the form illustrated in 
Fig. 9.5. This is very similar to the graphical construction in Fig. 7.14 except for the fact that the 
frequency response of the filter and the frequency spectrum of the window function are periodic in the 
present application. As may be easily deduced following the steps in Sec. 7.8.1, the main-lobe width 
of the window will introduce transition bands at frequency points where the frequency response of 
the filter has discontinuities, i.e., at passband edges. On the other hand, the side ripples of the window 
will introduce ripples in the passband(s) of the filter whose amplitudes are directly related to the 
ripple ratio of the window function used. 

A variety of window functions have been described in the literature in recent years and some 
of them are as follows [1,2]: 

1. Rectangular 

2. von Hann 2 

3. Flamming 

4. Blackman 

5. Dolph-Chebyshev 

6. Kaiser 

The first four windows have only one adjustable parameter, the window length N. The last two, 
namely, the Dolph-Chebyshev and the Kaiser windows, have two parameters, the window length and 
one other parameter. 

9.4.1 Rectangular Window 

The rectangular window is given by 


w R (nT ) 



tor |«| < 
otherwise 


and its frequency spectrum has been deduced in Sec. 7.8.2 as 


W R (e^ T ) = 


sin (coNT /2) 
sin(tt>r/2) 


(9.18) 


(9.19) 


Its main-lobe width is 2 a> s /N and its ripple ratio remains relatively independent of N at approximately 
22 percent for values of N in the range 11 to 101. 

The rectangular window corresponds, of course, to the direct truncation of the Fourier series 
and the effect of direct truncation on llief"' 1 ) is quite evident in Fig. 9.4. As N is increased the 
transition width between passband and stopband is decreased, an effect that is common in all windows. 
Flowever, the amplitudes of the last passband and first stopband ripples remain virtually unchanged 
with increasing values of N, and this is a direct consequence of the fact that the ripple ratio of the 
rectangular window is virtually independent of N (see Fig. 7.10). 


2 Due to Julius von Hann and often referred to inaccurately as the Hanning window function. 
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H(e imT ) 













t t 



(d) 



(e) 


Figure 9.5 Convolution integral of Eq. (9.17). 
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.2 von Hann and Hamming Windows 

The von Hann and Hamming windows are essentially one and the same and are both given by the 
raised-cosine function 


w H (nT) = 


a + (1 — a) cos 

0 


2 Jtn 

N - 1 


for \n\ < 
otherwise 


(9.20) 


where a = 0.5 in the von Hann window and a — 0.54 in the Hamming window. The small increase 
in the value of a from 0.5 to 0.54 in the latter window has a beneficial effect, namely, it reduces the 
ripple ratio by about 50 percent (see Table 9.2 below). 

The spectrums of these windows can be related to that of the rectangular window. Equation 
(9.20) can be expressed as 


w H (n T) = w R (nT) 


a + (1 — a) cos 


2 jtn 


N - 1 


= uw R (nT) + 


1 — a 


w R (nT)(e j27ln/(N - 1) + e -t 2jr "/(v-t)) 


and on using the time-shifting theorem of the z transform (Theorem 3.4), we have 
W H {e jmT ) = Z[w H (nT )] . 

z=e ja)T 

= aW R {e^ T ) + -^W R (e^ T - 2 ^ N ~ 1)] ) 


1 — a 


W K ( 


,j[(oT+2n/(N—l)] \ 


(9.21a) 


Table 9.2 Summary of window parameters 



Main-lobe 

Ripple ratio, % 

Type of window 

width 

N = 11 N = 21 

N= 101 

Rectangular 

2ft) s 

22.34 21.89 

21.70 

von Hann 

4ft)j 

If 

2.62 2.67 

2.67 

Hamming 

4ft). s 

~N~ 

1.47 0.93 

0.74 


Blackman 


6fti, 

~N 


0.08 


0.12 


0.12 
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Figure 9.6 Spectrum of von Hann or Hamming window. 


Now from Eqs. (9.19) and (9.21a), we get 


W H (e j “ T ) = 


a s,in(coNT /2) 
sin(tt>r/2) 



s,u\[toNT/2 - Njt/(N - 1)] 
sin[®r/2 — 7 r/(N — 1)] 


1 — a sm[coNT/2 + Njt/(N — l)] /noiu\ 

+ ~2 sin[coT/2 + tv/(N - 1)] (9.21b) 

Consequently, the spectrums for the von Hann and Hamming windows can be formed by simply 
shifting Wn(e' mT ) first to the right and then to the left by 2tt /(N — 1)7’ and after that adding the 
three spectral components in Eq. (9.21b) as illustrated in Fig. 9.6. As can be observed, the second 
and third terms tend to cancel the first right and first left side lobes in a Wr (e 1 " ,T ), and as a result both 
the von Hann and Hamming windows have reduced side lobe amplitudes compared with those of the 
rectangular window. For iV =11 and co s = 10 rad/s, the ripple ratios for the two windows are 2.62 
and 1.47 percent and change to 2.67 and 0.74 percent, respectively, for N = 101 (see Table 9.2). 
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The first term in Eq. (9.21b) is zero if 


oo = 


mco s 


and, similarly, the second and third terms are zero if 


f N 

co = \ m H- 

V N - 1 


co s 

~N 


, ( N \ CDs 

and co = \ m -— 

V N -ij N 


respectively, for m = ±1, ±2, ... . If N 1, all three terms in Eq. (9.21b) have their first common 
zero at \co\ ~ 2co s /N, and hence the main-lobe width for the von Hann and Hamming windows is 
approximately 4 co s /N. 


9.4.3 Blackman Window 

The Blackman window is similar to the preceding two and is given by 

( 2jtn Ann N — 1 

0.42 + 0.5 cos-h 0.08 cos- for Ini < - 

N — 1 N - 1 1 1 - 2 

0 otherwise 

The additional cosine term leads to a further reduction in the amplitude of Gibbs’ oscillations. The 
ripple ratio for N = 11 and co s = 10 rad/s is 0.08 percent and changes to 0.12 percent for N = 101. 
The main-lobe width, however, is increased to about 6co s /N (see Table 9.2). 

As can be seen in Table 9.2, as the ripple ratio is decreased from one window to the next one, 
the main-lobe width is increased. This happens to be a fairly general trade-off among windows. 


Example 9.2 


Redesign the lowpass hlter of Example 9.1 using the von Hann, Hamming, and 
Blackman windows. 


■ Solution 

The impulse response is the same as in Example 9.1, that is, 

1 

h(nT ) = —sin co c nT 
nn 

On multiplying h{nT) by the appropriate window function and then using Eqs. (9.15) 
and (9.14), in this order, we obtain 

(N- 1)/2 , 

H' w (z) = z- {N ~ l)/2 y(^ + 2“") ■ 

n =0 

where Aq = w(0)h(0) and u' n — 2w(nT)h(nT ) 
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Figure 9.7 Amplitude response of lowpass filter (Example 9.2). 


The amplitude responses of the three filters are given by 


M(co) = 


(N- 1)/2 

a' n cos con T 

n =0 


These are plotted in Fig. 9.7 for N — 21 and co s = 10 rad/s. As expected, the amplitude 
of the passband ripple is reduced, and the minimum stopband attenuation as well as the 
transition width are increased progressively from the von Hann to the Hamming to the 
Blackman window. 


9.4.4 Dolph-Chebyshev Window 

The windows considered so far have a ripple ratio which is practically independent of N, as can be 
seen in Table 9.2, and as a result the usefulness of these windows is limited. A more versatile window 
is the so-called Dolph-Chebyshev window [3]. This window is given by 


w DC (nT) = 


1 


(N- 1)/2 


/=! 


( in N 

2/1711 

r cos A y 

cos- 

N 


(9.22) 


for n = 0, 1,2 ,,{N — l)/2 where r is the required ripple ratio as a fraction and 


1 


1 

cosh - 


xq = cosh 


N — 1 


r 
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Function T k (x) is the /:th-order Chebyshev polynomial associated with the Chebyshev approximation 
for recursive filters (see Sec. 10.4.1) and is given by 


Tk(x) = 


cos(A:cos 1 x) 
cosh(cosh _1 x) 


for |x| < 1 
for |x| > 1 


Evidently, an arbitrary ripple ratio can be achieved with this window and, as in other windows, the 
main-lobe width can be controlled by choosing the value of N. 

The Dolph-Chebyshev window has two additional properties of interest. First, with N fixed, 
the main-lobe width is the smallest that can be achieved for a given ripple ratio; second, all the 
side lobes have the same amplitude, as can be seen in Fig. 9.8, that is, its amplitude spectrum is 
equiripple. A consequence of the first property is that filters designed by using this window have a 
narrow transition band. A consequence of the second property is that the approximation error tends 
to be somewhat more uniformly distributed with respect to frequency. 

There is a practical issue in connection with most windows, including the Dolph-Chebyshev 
window, which needs to be addressed. We have assumed an ideal passband amplitude response of 
unity in the filters considered so far and typically the response of the designed filter is required to oscil¬ 
late about unity. The value of the filter gain at any given frequency depends on the area of the window 
spectrum, as can be seen in Fig. 9.5, and if the passband gain is required to be approximately equal to 
unity, then the area of the window spectrum should be approximately equal to 2tz/ T to cancel out the 
factor T/(2: r) in the convolution integral of Eq. (9.17). For the Kaiser window, this turns out to be the 
case. However, in the case of the Dolph-Chebyshev window, the area of the window spectrum tends to 



Figure 9.8 Amplitude spectrum for Dolph-Chebyshev window (IV = 21, ripple ratio = —20 dB). 
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depend on the ripple ratio and, consequently, the passband gain will oscillate about some value other 
than unity. The problem can be easily circumvented by simply scaling the values of the impulse 
response by a suitable factor after the design is completed. This amounts to scaling the amplitude 
response by the same factor as can be readily verified. Depending on the application at hand, one 
may want the amplitude response to have a maximum value of unity (or 0 dB), or to oscillate about 
unity, or to do something else. In the first case, one would need to find the maximum value of the 
passband amplitude response as a ratio, say, M max and then divide all the values of the modified 
impulse response by M max , that is, 

, h w (nT) 

h w {nT) = —^—- for - (N - l)/2 < n < (N - l)/2 

^max 

On the other hand, if the passband amplitude response is required to oscillate about unity, then one 
would need to scale the impulse response values with respect to the average passband response by 
letting 


h'J nT ) = where M AV = ^(M max + M mm ) (9.23) 

Mav 

and M m ; n is the minimum of the passband amplitude response. This scaling technique, which is also 
known as normalization of the amplitude response, is illustrated in the following example. 


Example 9.3 


(a) Using the Fourier-series method along with the Dolph-Chebyshev window, 
design a nonrecursive highpass filter assuming the idealized frequency response 


H(e jcoT ) = 


1 

< 1 
0 


for — co s /2 < co < — co c 
for co c < co < co s /2 

otherwise 


The required filter parameters are as follows: 

• Ripple ratio: —20 dB 

• co c : 6.0 rad/s 

• co s : 20 rad/s 

• N = 21 


( b ) Assuming that the passband of the filter extends from 6.8 to 10 rad/s, normalize the design 
obtained in part (a) so as to achieve an amplitude response that oscillates about unity, (c) Find 
the passband peak-to-peak ripple A p in dB. (cl) Assuming that the stopband extends from 0 to 
5.5 rad/s, find the minimum stopband attenuation A a in dB. 
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■ Solution 

(a) From Eq. (9.11), we have 
h(nT) = 



e jQlnT dev + 


r<»s/2 

I ‘ 

J (Dr 


e jconT dev 


joinT 


—OJ c 

r^jconTl 

<o s /2\ 

+ 

-o) s / 2 

jnT 

J 


= —[sin<w s «T/2 — smev c nT) 
nn 

1 

= —[sin nn — sin ev c nT] 
nn 

We note that (sin nn)/nn is always zero except for n = 0 and hence we get 

1-— sin ev r nT for n = 0 


h(nT) = 


(9.24) 


- — sin eo c n T 

nn u 


otherwise 


The ripple ratio in dB is given by 20 log r and hence 

20 log r = —20 or r = 10 _I = 0.1 

OnusingEqs. (9.22) and (9.24), the design of Table 9.3 wher eh w (nT) = w ncdnT )li(nT) 
can be obtained. ■ 

(b) The amplitude response can be computed by using the formula for a symmetri¬ 
cal impulse response of odd length in Table 9.1. Through a simple MATLAB m-file 
the maximum and minimum values of the passband amplitude response can be 

Table 9.3 Numerical values of h(nT) 
and w DC (nT)h(nT) (Example 9.3) 


n 

h(nT) = h(- 

-nT) 


-nT) 

0 

4.000000E - 

1 

2.343525 E - 

1 

1 

-3.027307 E - 

1 

-1.758746E - 

1 

2 

9.354893E - 

2 

5.298466E - 

2 

3 

6.236595 E - 

2 

3.384614E - 

2 

4 

-7.568267E - 

2 

-3.865863E - 

2 

5 

0.0 


0.0 


6 

5.045512E - 

2 

2.155795E - 

2 

7 

-2.672827 E - 

2 

-1.012015E - 

2 

8 

-2.338723E - 

2 

-7.661656E - 

3 

9 

3.363674 E - 

2 

9.278868E - 

3 

10 

0.0 


0.0 
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Figure 9.9 Amplitude response of lowpass filter (Example 9.3). 


obtained as 

M max = 0.6031 and M min = 0.5737 

Hence the required scaling factor to normalize the passband amplitude response to unity 
is obtained from Eq. (9.23) as Mav = 0.5884. The amplitude response of the filter is 
plotted in Fig. 9.9. ■ 

(c) The peak-to-peak passband ripple in dB can be obtained as 

Ap = 20 log M max - 20 log M mm = 20 log = 0.43 dB ■ 

^min 

(d) The minimum stopband attenuation A a is defined as the negative of the maximum 
stopband gain and it can be computed as 0.01549. Hence we have 

A a = -20 log 0.01549 = 20 log- 1 -= 36.2 dB ■ 

6 6 0.01549 


In view of the equiripple amplitude spectrum of the Dolph-Chebyshev window, one could 
expect to obtain an equiripple amplitude response for the filter. However, it does not work out that 
way because the relation between the amplitudes of the ripples in the filter response and those in the 
window spectrum is nonlinear. The nonlinear nature of this relation can be verified by examining the 
graphical construction of the convolution integral in Fig. 9.5. 
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9.4.5 Kaiser Window 

The Kaiser window [4] and its properties have been described in Sec. 7.8.1. As will be shown below, 
this window can be used to design nonrecursive filters that satisfy prescribed specifications and it is, 
therefore, used widely. For this reason, its main characteristics are repeated here for easy reference. 
The window function is given by 


w K (nT ) = 


W) 

/o(«) 

0 


for \n\ < 
otherwise 


N - 1 


2 


where a is an independent parameter and 


P — a 



2n 

N - 1 


2 


oo 

I 0 (x) =1 + ^1 

k= 1 


[ 1 / 

X\k 

k\ v 

2/ 


The exact spectrum of WfcinT) can be readily obtained from Eq. (9.16b) as 

(2V—1)/2 

W/cie^ 7 ) = wk( 0) + 2 55 wt;(nT)cosconT 

n= 1 


(9.25) 


and an approximate but closed-form formula was given in Sec. 7.8.2 (see Eq. (7.32)). 

The ripple ratio can be varied continuously from the low value in the Blackman window to the 
high value in the rectangular window by simply varying the parameter a. Also, as in other windows, 
the main-lobe width, designated as B m , can be adjusted by varying N. The influence of a on the 
ripple ratio and main-lobe width is illustrated in Fig. 7.17a and b. 

An important advantage of the Kaiser window is that a method is available that can be used to 
design filters that will satisfy prescribed specifications [4], The design method is based on the fact 
that while the ripple ratio affects both the passband ripple and the transition width between passband 
and stopband, the window length N affects only the transition width. Consequently, one can choose 
the a of the window through some empirical formulas to achieve the required passband or stopband 
ripple and then through another empirical formula one can choose the window length to achieve the 
desired transition width. The nuts and bolts of the method are as follows: 


9.4.6 Prescribed Filter Specifications 

In a filter designed through the use of the Kaiser window, the passband amplitude response oscillates 
between 1 — 5 and 1+5 whereas the stopband amplitude response oscillates between 0 and 5 where 
5 is the amplitude of the largest passband ripple, which happens to be the same as the amplitude 
of the largest stopband ripple. Hence the vital characteristics of a lowpass filter can be completely 
specified as illustrated in Fig. 9.10a where 0 to o> p and co a to a> s /2 define the passband and stopband, 
respectively. A prescribed set of specifications 5, a> p , and co a can be achieved for some specified 
sampling frequency co s by choosing the parameter a and the length N of the Kaiser window such 
that the amplitude response never crosses into the shaded areas in Fig. 9.10a. 

Typically in practice, the required filter characteristics are specified in terms of the peak-to- 
peak passband ripple A p and the minimum stopband attenuation A a in dB as defined in the solution 
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Figure 9.10 Idealized frequency responses: (a) Lowpass filter, (b) highpass filter. 

of Example 9.3. For a lowpass filter specified by Fig. 9.10 a, we have 

1 +8 

A p = 20 log --- (9.26) 

l — o 

alld A a = —20 log 5 (9.27) 

respectively, and the transition width is given by 

B t = w fl - co p 

Given some arbitrary passband ripple and minimum stopband attenuation, say, A p and A a , respec¬ 
tively, it may or may not be possible to achieve the required specifications exactly. If it is possible, 
that would be just fine. If it is not possible to get the exact specifications, the next best thing is to 
design a filter such that 

Ap S A p for 0 < co < co p 
























DESIGN OF NONRECURSIVE (FIR) FILTERS 447 


and 

A a > A a for a> a < a> < co s /2 

i.e., design a filter that would oversatisfy one or both specifications. This is a recurring theme in the 
design of filters both for nonrecursive as well as recursive. 

A filter with a passband ripple equal to or less than A p , a minimum stopband attenuation 
equal to or greater than A a , and a transition width B, can be readily designed by using the following 
procedure [4]: 


1. Determine h(nT) using the Fourier-series approach of Sec. 9.3 assuming an idealized frequency 
response 


H(e’ wT ) = 

(dashed line in Fig. 9.10 a) where 


I 1 for \o)\ < (D c 
I 0 for a> c < \(i>\ < (ti s /2 


(ti c — 2 T ^a) 

2. Choose S in Eqs. (9.26) and (9.27) such that A p < A p and A a > A a . A suitable value is 

5 = min(5 p , 8 a ) 


where 


in0.05i p _ 1 

8 P = - - and = lO- 0054 - 

p 10 0.05A„ + l 


3. With the required <5 defined, the actual stopband loss A a in dB can be calculated using Eq. (9.27). 

4. Choose parameter a as 


0 


for A n < 21 dB 


ol = { 0.5842(A fl - 21) 0 - 4 + 0.07886(A a - 21) for 21 < A a < 50 dB 


0.1102(A fl - 8.7) 

5. Choose parameter D as 


for A n > 50 dB 


0.9222 
D ={ A a - 7.95 


14.36 


for A a < 21 dB 
for A a > 21 dB 


Then select the lowest odd value of N that would satisfy the inequality 

(OcD 


6. Form wk(iiT) using Eq. (9.25). 

7. Form 


H' w {z) = Z- (N ~ l)/2 H w (z) where H w (z) = Z[w K (nT)h(nT )] 
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Example 9.4 


Design a lowpass filter that would satisfy the following specifications: 


• Maximum passband ripple in frequency range 0 to 1.5 rad/s: 0.1 dB 

• Minimum stopband attenuation in frequency range 2.5 to 5.0 rad/s: 40 dB 

• Sampling frequency: 10 rad/s 


i Solution 

From step 1 and Example 9.1 
1 


h(nT) = — sin co c nT where a> c = 4(1.5 + 2.5) = 2.0 rad/s 

77 7T L 


Step 2 gives 


= 


1q 0.05(0.1) _ j 


p io 005(0 1) + 1 
s a = 1(T 005<40) = 0.01 


= 5.7564 X 10 


,-3 


Hence 

and from step 3 


S = 5.7564 x 10' 


Steps 4 and 5 yield 


Hence 


Finally steps 6 and 7 give 


A a = 44.797 dB 


a = 3.9524 D = 2.5660 


10(2.566) 

N > ——-- + 1 = 26.66 


N = 27 


where 


(N- 1)/2 

K(z) = Z~ iN ~ l)/2 J2 h w (nT)(z" + z~ n ) 

n =0 

h w (nT ) = w K (nT)h(nT) 


The numerical values of h(nT) and wK(nT)h(nT) are given in Table 9.4, and the ampli¬ 
tude response achieved is plotted in Fig. 9.11. This satisfies the prescribed specifications. 
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Table 9.4 Numerical values of h{nT) 
and w K (nT)h(nT) (Example 9.4) 


n 

h(nT) = h{- 

-nT) 

— ^Ul(" 

-nT) 

0 

4.000000E - 

1 

4.000000E - 

1 

1 

3.027307E - 

1 

2.996921E - 

1 

2 

9.354893E - 

2 

8.983587E - 

2 

3 

-6.236595 E - 

2 

-5.690178E - 

2 

4 

—7.568267 £ - 

2 

-6.420517E - 

2 

5 

0.0 


0.0 


6 

5.045512£ - 

2 

3.450028E - 

2 

7 

2.672827E - 

2 

1.577694E - 

2 

8 

-2.338723E - 

2 

-1.155982E - 

2 

9 

-3.363674E - 

2 

-1.343734E - 

2 

10 

0.0 


0.0 


11 

2.752097E - 

2 

6.235046E - 

3 

12 

1.559149E - 

2 

2.395736E - 

3 

13 

— 1.439214E - 

2 

-1.326848E - 

3 



Figure 9.11 Amplitude response of lowpass filter (Example 9.4). 

































450 DIGITAL SIGNAL PROCESSING 


The above design procedure can be readily used for the design of highpass filters. For the 
specifications of Fig. 9.1 Ob, the transition width and idealized frequency response in step 1 can be 
taken as 


Bt — (Op co a 


and 


H(e iaT ) = 


for —co s /2 < (o < — oo c 
for oo c <co < co s /2 

otherwise 


where co c =\{oo a + co p ) 

The remaining steps apply without modification. 

The procedure can also be extended to the design of multiband filters such as bandpass and 
bandstop filters. This is possible on account of the fact that the amplitudes of the passband and 
stopband ripples and the transition widths between passbands and stopbands depend directly on the 
ripple ratio of the window and its length and are independent of the number of filter bands. Thus all 
one needs to do for a multiband filter is to design the filter on the basis of the narrowest transition 
width. 

For the bandpass specifications of Fig. 9.12a, the design must be based on the narrower of the 
two transition bands, i.e., 


B t = min[(« pl - co al ), {oo a2 - co p2 )] 


(9.28) 


Flence 


H{e jmT ) = 


for — co C 2 < co < —co c i 
for COd < 00 < CO c 2 
otherwise 


(9.29) 


where 


B, 

OO c 1 = 0)p 1 - — 


^ B < 

a>c2 = 0)p 2 + - 


Similarly, for the bandstop specifications of Fig. 9.12fi, we let 


(9.30) 


B, = min [(tu a i - co pl ), (co p2 - <w fl2 )] 


and 


H(e jaT ) = 


1 

0 

1 


for 0 < \co\ < co c i 
for coci < \co\ < co c 2 
for co C 2 < \w\ < co s /2 


where 


^ B < 

COd = O0 p 1 + — 


00c2 — O0 p 2 


Bt_ 

2 


DESIGN OF NONRECURSIVE (FIR) FILTERS 


451 


1+5 

1.0 

1-5 


O 


1_1 







i 

i 

i 

i 

i 

i 

i 

1 


i 

1 



i 


1 

Val 

\ \ 

Up\ U)p2 

t " t 

U) a 2 

2 


1 


^c2 


(«) 


1+5 
1.0 - 

1 - 5 - 


5 



u p \ 


u a \ 


v c l 


\ 

u a 2 



Up2 

U C 2 


2 


(b) 


Figure 9.12 Idealized frequency responses: (a) Bandpass filter, ( b ) bandstop filter. 


Example 9.5 


Design a bandpass filter that would satisfy the following specifications: 


• Minimum attenuation for 0 < a> < 200: 45 dB 

• Maximum passband ripple for 400 < u> < 600: 0.2 dB 

• Minimum attenuation for 700 < co < 1000: 45 dB 

• Sampling frequency: 2000 rad/s 
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■ Solution 


From Eq. (9.28) 


B, = min [(400 - 200), (700 - 600)] = 100 
Hence from Eq. (9.30) 

co c i — 400 — 50 = 350 rad/s co c 2 — 600 + 50 = 650 rad/s 

Step 1 of the design procedure yields 

I ro> s /2 

h(nT) = — / H(e j0>T )e jwnT dco 

J-eo ,/2 


and from Eq. (9.29), we get 


1 

h{nT) = — 

r-o) c i 

/ e i0lnT dco + I 

r“>c2 

e jwnT dco 


(J) s 

J —0)c2 * 

(Del 



1 

~ e ~jo>cinT e -ja>cinT 


e ja>c 2 nT 

e jio cl nT- 


+ 

co s 

jnT jnT 

jnT 

jnT 

1 

' gjuanT _ e -jm c inT 

e 

ja/cinT _ £ 

-jcoanT ' 

nn 

[ 2j 


2 j 



1 

h(nT) = —( sma> C 2 nT — sinco c \nT) 
mx 

Now according to step 2, 


jq 0.05(0.2) _ j 


0 _ 

p ~ io 0 05(0 - 2 ) ■ 


1 


= 1.1512 x 10 


,-2 


S a = 10-° 05(45) = 5.6234 X 10" 3 
and S = 5.6234 x 10“ 3 

Thus from Eq. (9.27), we obtain 


A a = 45 dB 


The design can be completed as in Example 9.4. The resulting values for a, D, and N 
are 


a = 3.9754 D = 2.580 and N = 53 ■ 

The amplitude response achieved is plotted in Fig. 9.13. 

Note that if we let u> c \ = 0 and co c 2 = a> c or a> c 1 = co c and a > c 2 = ®j/2 in the above 
expression for h(nT), we get the impulse response for a lowpass or highpass filter, as 
may be expected (see Examples 9.1 and 9.3). Thus a computer program that can design 
bandpass filters can also be used to design lowpass and highpass filters. 
















DESIGN OF NONRECURSIVE (FIR) FILTERS 453 



Figure 9.13 Amplitude response of bandpass filter (Example 9.5). 


9.4.7 Other Windows 

There are several other window functions in the literature that can be applied in the design of nonre¬ 
cursive filters such as the Saramaki and ultraspherical windows [5,6]. Like the Dolph-Chebyshev and 
Kaiser windows, the Saramaki window offers an independent parameter in addition to the window 
length. The ultraspherical window is more flexible than the others because it offers two independent 
parameters in addition to the window length. Consequently, it is possible to achieve a great variety 
of spectral characteristics with it [7], even to design better quality or more economical filters. The 
ultraspherical window includes the Dolph-Chebyshev and Saramaki windows as special cases and 
it is also closely related to the Kaiser window. 


9.5 DESIGN BASED ON NUMERICAL-ANALYSIS FORMULAS 

In signal processing, a continuous-time signal often needs to be interpolated, extrapolated, differen¬ 
tiated at some instant t = t \, or integrated between two distinct instants t\ and fi. Such mathematical 
operations can be performed by using the many classical numerical-analysis formulas [8, 9, 10]. 
Formulas of this type, which are derived from the Taylor series, can be readily used for the design 
of nonrecursive filters. 

The most fundamental numerical formulas are the formulas for interpolation since they form 
the basis of many other formulas, including formulas for differentiation and integration. The most 
commonly used interpolation formulas are the Gregory-Newton , Bessel , Everett , Stirling, and Gauss 
interpolation formulas. The value of x(t) at t = nT + pT, where 0 < p < 1, is given by the 
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Gregory-Newton formulas as 

x(nT + pT) = (1 + A ) p x{nT) = 

and 

x(nT + pT) = (1 - V)~ p x{nT) = 

where 


l + pA+ ^-V - 
2 ! 


p(p +1) , 

1 + ^ V + 2 , V ' 


x(nT) 


x(nT ) 


A x(nT) — x(nT + 7) — x(nT) and V.r (nT) = x(nT ) — x(nT — 7) 

are commonly referred to as the forward and backward differences, respectively. On the other hand, 
the Stirling formula yields 


x(nT + pT) = 


, P(P ~ V 

2! 4! 


x{nT) 


+ [Sx(nT - \T) + 5x(«7 + ±7)] 


pip 2 - l) rs 3 


2(5!) 


[S 3 x(nT -\T) + 8 3 x(nT + \t)] 

[8 s x(nT -\T)+ 8 s x(nT + ±7)] 


2(3!) L " " v " 2 

pip 2 - [)ip 2 - 2 2 ) 


(9.31) 


where 

Sx(nT + \T) = x(nT + 7) - x(nT) (9.32) 

is known as the central difference. 

The forward, backward, and central difference operators are, of course, linear and, therefore, 
higher-order differences can be readily obtained. For example, 

8 3 x(iiT+\T) = 8 2 [8x(nT+ ±7)] 

= 8 2 [x(nT + 7) - x(nT)\ 

= 8[8x(nT + T) - 8x(nT)] 

= 8{x(nT + §7) — x(nT + \t) 

-[x(nT + \T)~x(nT-\T)]} 

= 8x(nT + IT) - 28x(nT + \_T) +8x{nT - \t) 

= [xinT + 27) - x(nT + 7)] - 2[x(nT + 7) - x(nT)] 

+[j(h7) — x{nT — 7)] 

= x(nT + 27) — 3x(nT + 7) + 3x(«7) — x(n7 — 7) 
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The first derivative of x(t ) with respect to time at t = nT + pT can be expressed as 


dx(nT + pT) dp 
= --- x — 

t=nT+pT dP dt 

= 1 d J^l±Pl} (9,33) 

T dp 

and, therefore, the above interpolation formulas lead directly to corresponding differentiation 
formulas. Similarly, integration formulas can be derived by writing 


dx(t) 

dt 


rti rP2 

/ x(t)dt = T x(nT + pT)dp 
J nT JO 


where nT < tz < nT + T and pj = ——— 

that is, 0 < p 2 < 1 • 

A nonrecursive filter that can perform interpolation, differentiation, or integration can now be 
obtained by expressing one of the above numerical formulas in the form of a difference equation. 
Let x(nT) and y(nT) be the input and output in a nonrecursive filter and assume that y(nT) is equal 
to the desired function of x(t), that is, 


y(nT) = f[x(t)\ (9.34) 

For example, iiy(nT) is required to be the first derivative of x(f ) at t = nT + pT, where 0< p < 1, 
we can write 


y{nT) = 


dx{t) 


dt 


t=nT+pT 


(9.35) 


By choosing an appropriate formula for f[x{t)] and then eliminating all the difference operators 
using their definitions, Eq. (9.34) can be put in the form 

M 

y(nT ) = E ajx{nT — iT) 

i=—K 

Thus the desired transfer function can be obtained as 

M 

H(z) = J2 h ( flT )z~ n 

n=-K 


For the case of a forward- or central-difference formula, H(z ) is noncausal. Hence for real-time 
applications it will be necessary to multiply H(z) by an appropriate negative power of z, which 
would convert a noncausal into a causal design. 
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Example 9.6 


A signal x (?) is sampled at a rate of 1 /T Hz. Design a sixth-order differentiator 
with a time-domain response 


y(nT) = 


dx(t ) 
dt 


Use the Stirling formula. 

■ Solution 

From Eqs. (9.31) and (9.33) 


y(nT) = 


dx(t ) 


dt 


t=nT 


= —[8x(nT-{T)+8x(nT+\T)\ 


-—[^x{nT-\T)+8\{nT+\T)] 

+ ^f[ 85 x( nr -~2 T )+ s5 x(' ir + l 2 T )}+- 

Now, on using Eq. (9.32) 

8x(nT -\T)+ 8x(nT + \t) = x(nT + T) - x(nT - T) 
8 3 x(nT - \T) + 8 3 x(nT + \T ) = x(nT + 2T) - 2x(nT + T) 

+ 2 x(nT — T) — x{nT — 2 T) 
8 5 x(nT - ^7) + 8 5 x(nT + \t) = x(nT + 3 T) - 4x(nT + 2T) 

+ 5x(nT+ T)-5x(nT -T) 
+ 4x(nT - 2 T) - xinT - 3 T) 

Hence 

1 

y (nT) = ——[x(nT + 3 T) - 9 x(nT + 2 T) + 45;r(«7’ + T) 

60 T 


-45 x(nT — T) + 9x(nT - 2T) - x(nT - 3E)] 


and, therefore 


H(z) = — (z 3 - 9z 2 + 45z - 45z _1 + 9z~ 2 - z" 3 ) ■ 

60 T 

Note that the differentiator has an antisymmetrical impulse response, i.e., it has a constant 
group delay, and it is also noncausal. A causal filter can be obtained by multiplying H(z ) 
by z~ 3 . The amplitude response of the differentiator is plotted in Fig. 9.14 for ca s — 2 jt. 









DESIGN OF NONRECURSIVE (FIR) FILTERS 457 



Figure 9.14 Amplitude response of digital differentiators (Examples 9.6 and 9.7). 


Differentiators can also be designed by employing the Fourier series method of Sec. 9.3. An 
analog differentiator is characterized by the continuous-time transfer function 

H(s) = s 

Hence a corresponding digital differentiator can be designed by assigning 

H(e ]ojl ) = jco for 0 < M < coj 2 (9.36) 

Then on assuming a periodic frequency response, the appropriate impulse response can be determined 
by using Eq. (9.11). Gibbs’ oscillations due to the transition in //(e-'" 7 ) at co — co s /2 can be reduced, 
as before, by using the window technique. 


Example 9.7 


Redesign the differentiator of Example 9.6 by employing the Fourier-series 
method. Use ( a ) a rectangular window and ( b ) the Kaiser window with a = 3.0. 


■ Solution 

(a) From Eqs. (9.36) and (9.11), we have 


l m/ 2 i /-tDs/2 

h(nT ) = — / jcoe i<onT dm = — - 

J-ioJ 2 Jo 


2m sin (conT)dco 
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On integrating by parts, we get 



simrn 


or 


J° 

h(nT) = { 1 


for n — 0 


otherwise 


— cos Ten 
nT 


Now if we use the rectangular window with N = 7, we deduce 


H w (z) = — (2z 3 - 3z 2 + 6z~6z~ l + 3z~ 2 - 2z ~ 3 ) ■ 


( b ) Similarly, the Kaiser window yields 


3 


HM) = Y, w K(nT)h(nT)z~ n • 


where wkIjiT) can be computed using Eq. (9.25). The amplitude responses of the two 
differentiators are compared in Fig. 9.14 with the response of the differentiator obtained 
in Example 9.6. 


As before, the parameter a in the Kaiser window can be increased to increase the in-band 
accuracy or decreased to increase the bandwidth. Thus the differentiator obtained with the Kaiser 
window has the important advantage that it can be adjusted to suit the application. The design of 
digital differentiators satisfying prescribed specifications is considered in Refs. [11, 12] (see also 
Sec. 15.9.3). 
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PROBLEMS 

9.1. (a) A nonrecursive filter is characterized by the transfer function 

„. . 1 + 2z + 3z 2 + 4z 3 + 3z 4 + 2z 5 + z 6 
tf(z) = -i- 


Find the group delay. 
( b ) Repeat part ( a ) if 


H(z) = 


1 - 2z + 3z 2 - 4z 3 + 3z 4 - 2z 5 + z 6 


9.2. Figure P9.2 shows the zero-pole plots of two nonrecursive filters. Check each filter for phase-response 
linearity. 




9.3. A nonrecursive bandstop digital filter can be designed by applying the Fourier series method to the 
idealized frequency response: 

{ 1 for \a>\ < a> cl 
0 for a> cl < M < a > C 2 

1 fora > C 2 £ M 5 tt> s /2 

(a) Obtain an expression for the impulse response of the filter. 

(a) Obtain a causal transfer function assuming a filter length At = 11. 
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9.4. A nonrecursive digital filter can be designed by applying the Fourier series method to the idealized 
frequency response: 



1 for a > c 3 < \a>\ < oi c 4 rad/s 

0 fora > C 4 < |<w| < a>j /2 rad/s 


(a) Obtain an expression for the impulse response of the filter using the Fourier-series method. 

(a) Obtain a causal transfer function assuming a filter length N = 15. 

9.5. (a) Derive an exact expression for the spectrum of the Blackman window. 

(b) Using the result in part (a) and assuming that I»l, show that the main-lobe width for the Blackman 
window is approximately 6 co s /N. 

9.6. (a) Design a nonrecursive highpass filter in which 


H(e jaT ) « | J 


for 2.5 < \a>\ < 5.0 rad/s 
for M < 2.5 rad/s 


Use the rectangular window and assume that co s = 10 rad/s and N = 11. 

( b ) Repeat part (a) with N = 21 and N = 31. Compare the three designs. 

9.7. Redesign the filter of Prob. 9.6 using the von Hann, Flamming, and Blackman windows in turn. Assume 
that N = 21. Compare the three designs. 

9.8. Design a nonrecursive bandpass filter in which 



Use the von Flann window and assume that a> s = 2000 rad/s and N = 21. Check your design by plotting 
the amplitude response over the frequency range 0 to 1000 rad/s. 

9.9. Design a nonrecursive bandstop filter with a frequency response 



Use the Flamming window and assume that ai s = 2000 rad/s and N = 21. Check your design by plotting 
the amplitude response over the frequency range 0 to 1000 rad/s. 

9.10. A digital filter is required with a frequency response like that depicted in Fig. P9.10. 

(a) Obtain a nonrecursive design using the rectangular window assuming that cu s = 10 rad/s and N =21. 

( b ) Repeat part (a) using a Dolph-Chebyshev window with a ripple ratio of — 30 dB. 

(c) Repeat part (a) using a Kaiser window with an a of 3.0. 
id) Compare the designs obtained in parts (a) to (c). 
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9.11. A digital filter with a frequency response like that depicted in Fig. P9.11 is required. 

(a) Obtain a nonrecursive design using a rectangular window assuming that co s = 10 rad/s and N = 21. 

( b ) Repeat part (a) using a Dolph-Chebyshev window with a ripple ratio of — 20 dB. 

(c) Repeat part (a) using a Kaiser window with an a of 2.0. 

(. d) Compare the designs obtained in parts (a) to (c). 



9.12. (a) Using the idealized amplitude response in Example 9.5, design a bandpass filter using the Dolph- 

Chebyshev window. The required filter specifications are as follows: 

• Ripple ratio: —20 dB 

• cd c i = 3.0, co C 2 = 7.0 rad/s 

• N = 21 

• ci)j = 20 rad/s 

( b ) Assuming that the passband extends from 3.8 to 6.8 modify the design in part (a) so as to achieve an 
amplitude response that oscillates about unity. 

(c) Find the passband peak-to-peak ripple Ap in dB. 

(d) Assuming that the lower and upper stopbands extend from 0 to 2.1 and 7.9 to 10 rad/s, respectively, 
find the minimum stopband attenuation. 

9.13. (a) Repeat Prob. 9.12 assuming a ripple ratio of—25 dB. 

( b ) Compare the design of this problem with that of Prob. 9.12. 

9.14. Show that the Kaiser window includes the rectangular window as a special case. 

9.15. (a) Repeat Prob. 9.12 using a Kaiser window with a = 1.0. 

( b ) Repeat Prob. 9.12 using a Kaiser window with a = 4.0. 

(c) Compare the designs in parts (a) and ( b ). 






462 DIGITAL SIGNAL PROCESSING 


9.16. Design a nonrecursive lowpass filter that would satisfy the following specifications: 

A p <0.1dB A a > 44.0 dB 
cv p = 20 rad/s w a = 30 rad/s co s = 100 rad/s 

9.17. Design a nonrecursive highpass filter that would satisfy the following specifications: 

A p < 0.3 dB A a > 45.0 dB 
a>p = 3 rad/s a> a = 2 rad/s a> s = 10 rad/s 

9.18. Design a nonrecursive bandpass filter that would satisfy the following specifications: 

A p S 0.5 dB A a > 35.0 dB a> p \ = 40 rad/s oi p2 = 60 rad/s 

co a i = 20 rad/s ai a2 = 80 rad/s a> s — 200 rad/s 

9.19. Design a nonrecursive bandstop filter that would satisfy the following specifications: 

A p < 0.2 dB A a > 40 dB a> p i = 1000 rad/s a> p2 = 4000 rad/s 

w a i = 2000 rad/s u> a2 = 3000 rad/s a> s = 10,000 rad/s 


9.20. (a) Show that 


ZV k x(nT) = (l-z~ i ) k X(z) 


( b ) A signal x(t) is sampled at a rate of 2n rad/s. Design a sixth-order differentiator in which 

dx(t) 


y(nT) ■ 


dt 


Use the Gregory-Newton backward-difference formula. 

(c) Repeat part (b) using the Stirling central-difference formula. 


9.21. The phase response 9(a>) of a digital filter is sampled at a) — nSi for n — 0, 1, 2,.... Design a sixth-order 
digital differentiator that can be used to generate the group delay of the digital filter. Use the Stirling 
formula. 


9.22. A signal x(t) is sampled at a rate of 2n rad/s. Design a sixth-order integrator filter in which 

r(«+D T 

y(nT) ~ / x(t)dt 
J nT 

Use the Gregory-Newton backward-difference formula. 

9.23. Two digital filters are to be cascaded. The sampling frequency in the first filter is 2jr rad/s, and that in 
the second is 4 jt rad/s. Design a sixth-order interface using the Gregory-Newton backward-difference 
formula. Hint. Design an interpolating filter. 




CHAPTER 

10 


APPROXIMATIONS 
FOR ANALOG 
FILTERS 


10.1 INTRODUCTION 

As mentioned in the introduction of Chap. 8, the available approximation methods for recursive dig¬ 
ital filters can be classified as indirect or direct. Alternatively, they can be classified as noniterative 
or iterative. In indirect methods a discrete-time transfer function that would satisfy certain required 
specifications is deduced from a corresponding continuous-time transfer function through the appli¬ 
cation of certain transformations. In effect, indirect methods entail a closed-form formulation and 
they are, therefore, noniterative. The continuous-time transfer function is obtained by using one of 
several classical approximation methods for analog filters. On the other hand, in direct methods, a 
discrete-time transfer function is generated directly in the z domain usually using an optimization 
algorithm of some kind, i.e., direct methods are also iterative most of the time. 

Indirect methods have a historical basis. As detailed in Chap. 1, analog filters began to emerge 
around 1915 and during the first half of the 20th century some really powerful analog-filter approx¬ 
imation methods were invented [ 1-5]. When digital filters appeared on the scene during the 1960s, 
it was quite natural for engineers to attempt to obtain digital-filter approximations by adapting, 
modifying, or transforming well-established analog-filter approximations. It is now clear, that these 
indirect methods have passed the test of time and are, as a consequence, very much a part of a modem 
DSP designer’s tool kit. This hypothesis can be verified by counting the analog-filter approximation 
methods found in MATLAB, for example. 

This chapter considers in some detail several analog-filter approximation methods that are 
suitable for the design of filters with piecewise-constant amplitude responses, i.e., filters whose 
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passband and stopband gains are constant and zero, respectively, to within prescribed tolerances. 
The most frequently used approximation methods of this type are as follows: 

1. Butterworth 

2. Chebyshev 

3. Inverse-Chebyshev 

4. Elliptic 

5. Bessel-Thomson 

In the first four methods, attention is focused on deriving a continuous-time transfer function 
that would yield a specified amplitude response (or loss characteristic) and no particular attention 
is paid to the associated phase response. This is in contrast with the design of nonrecursive filters 
whereby the linearity of the phase response is imposed at the outset, as may be recalled from Chap. 9. 
In consequence, the phase response achieved through these analog-filter approximations turns out to 
be nonlinear and, as a result, the group delay tends to vary with frequency. This may present a problem 
in applications where phase distortion is undesirable (see Sec. 5.7). In the fifth approximation method, 
namely, the Bessel-Thomson [6] method, a constraint is imposed on the group delay associated with 
the transfer function, which results in a fairly linear phase response over a certain frequency range. 

The chapter begins with an introductory section dealing with the terminology and charac¬ 
terization of analog filters. While digital-filter designers talk about amplitude responses and gains, 
their analog-filter counterparts are more inclined to deal with loss characteristics and losses. This 
is because passive RLC analog filters, the forefathers of all filters, can provide only loss which can 
vary from zero to some large positive value. However, there is also a practical reason in describing 
analog filters in terms of loss characteristics. The derivations of the necessary formulas for the various 
approximations are that much easier to handle. The treatment of the basics provided is somewhat 
cursory and it is intended as a refresher. The interested reader is referred to Refs. [1-5] and also to a 
survey article written by the author in Ref. [7] for a more detailed exposition. 

The derivations provided deal with lowpass approximations since other types of approximations 
can be readily obtained through the application of transformations. Suitable transformations for the 
design of highpass, bandpass, and bandstop filters are described at the end of the chapter. 

It should be mentioned that the derivation of the formulas for the elliptic approximation is 
quite demanding as it entails a basic understanding of elliptic functions. Fortunately, however, the 
formulas that give the transfer-function coefficients can be put in a fairly simple form that is easy to 
apply even for the uninitiated. The elliptic approximation is treated in detail here because it yields 
the lowest-order transfer function for filters that are required to have prescribed piecewise-constant 
loss specifications, which makes it the optimal approximation for such applications. The reader who 
is interested in the application of the method may skip the derivations and proceed to Sec. 10.6.6 
for a step-by-step procedure for the design. The reader who is also interested in the derivation of 
this very important method may start by reading Appendix B which provides a brief review of the 
fundamentals of elliptic functions. 

The application of analog-filter approximations in the design of recursive digital filters will be 
considered in Chaps. 11 and 12. Chapter 12 considers, in addition, n delay-equalization technique that 
can be used in conjunction with the above methods for the design of digital filters with approximately 
linear phase response. Optimization methods that can be used to design recursive filters and equalizers 
can be found in Chap. 16. 
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10.2 BASIC CONCEPTS 

The basics of analog filters bear a one-to-one correspondence with the basics of digital filters, i.e., 
characterization, time-domain analysis, stability, frequency-domain analysis, and so on. 

10.2.1 Characterization 

An «th-order linear causal analog filter with input u,(t) and output v a (t) such as that in Fig. 10.1 can 
be characterized by a differential equation of the form 

d n v 0 (t) d n ~ l v 0 (t) d" Vi (?) d n ~ l Vi(t) 

K -fir- + b "-' -rfi,+ ■ ■ ■ + = a - -fir- + fl "-> + - + aov ,(0 

( 10 . 1 ) 

The coefficients ao, a\,, a„ and bo, b\, ... , b„ are functions of the element values and are real 
since the parameters of the filter (e.g., resistances, inductances, and so on) are real. The element 
values can be time-dependent in real life but are assumed to be time-invariant in theory. 


10.2.2 Laplace Transform 

The representation and analysis of discrete-time systems is facilitated through the use of the z 
transform. The transform of choice for analog filters and continuous-time systems in general is, of 
course, the Laplace transform which has already been encountered in Sec. 6.5.2. It is defined as 

/ OO 

x(t)e~ s< dt (10.2) 

-OO 

where s is a complex variable of the form s = a + jco. Signal x(t) can be recovered from X(s) by 
applying the inverse Laplace transform which is given by 

1 rC+joo 

x(t)=— X(s)e st ds (10.3) 

JC—j oo 


where C is a positive constant. 



Figure 10.1 Passive RLC analog filter. 
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The Laplace transform can be obtained by letting jco -> s in the Fourier transform (see 
Fig. 6.13) and, therefore, it is an analytic continuation of the latter transform (see Sec. A.8). As for 
the Fourier and z transforms, short-hand notations can be used for the Laplace transform, i.e., 

X(s ) = Cx(t) and x(t ) = C~ l X{s) or X(.y) ** x{t) 


10.2.3 The Transfer Function 

The Laplace transform of the Arth derivative of some function of time x(t) is given by 


d k x(t) 

dt k 


= s k X(s ) - /-^(O) - s k ~ 2 


dx(t) 

dt 


1=0 


d k ~ l x(t) 


dt k ~ l 


r=0 


where 


d k ~ l x(t) 


are said to be the initial conditions of x(t). In an analog filter, initial conditions are associated with 
the presence of charges in capacitors and inductors. In the present context, the analog filter can be 
safely assumed to be initially relaxed and thus all initial conditions can be deemed to be zero. On 
applying the Laplace transform to the differential equation in Eq. (10.1), we obtain 

(b n s" + b n _\s n 1 + • • • + bo)V 0 (s) = ( a n s n + a n -\s" *+•••+ flo)V,(s) 


x(0) 


dx(t) 

dt 


and thus 


Vo(s) 

Vj(s) 


E'U biS 


= H{s) 


00.4) 


This equation defines the transfer function of the filter, H(s), which can also be expressed in terms 
of its zeros and poles as 


H(s ) = 


WQ) = IILl^ - Zi) 
d(s ) °ni' = i(i - Pi) 


(10.5) 


The transfer function of a continuous-time system plays the same key role as that of a discrete¬ 
time system. It provides a complete description of the filter both in the time and frequency domains. 


10.2.4 Time-Domain Response 

The time-domain response of an analog filter can be expressed in terms of the time convolution as 


v 0 (t) = 


h{r)Vi{t — r)dr 



APPROXIMATIONS FOR ANALOG FILTERS 467 


where h(t) is the response of the filter to the continuous-time impulse function 8(t). Now from the 
time-convolution theorem of the Fourier transform (Theorem 2.14), we can write 

V 0 (jw) = H (jaj)Vj(jcv) (10.6a) 

that is, the Fourier transform (or frequency spectrum) of the output signal is equal to the Fourier 
transform of the impulse response times the Fourier transform of the input signal. If we now let 
jco — s, we obtain 


V 0 (s) = H(s)Vj (s ) 


(10.6b) 


or 


His) = ^ (10.6c) 

Vj(s) 

Eq. (10.6c) is essentially the same as Eq. (10.4) and, in effect, the transfer function of an analog filter 
is one and the same as the Laplace transform of the impulse response. 

The response of an analog filter to an arbitrary excitation can be deduced by obtaining the 
inverse Laplace transform of V 0 (s ) and from Eq. (10.6b), we have 

vM) = C~ l [H(s)V i (s)] 


If (i) the singularities of V 0 (s) in the finite plane are poles, and (ii) F 0 (s) —> 0 uniformly with respect 
to the angle of s as |s| -> oo with a < C, where C is a positive constant, then [8] 


v a (t) = 


f° 

| 2 \ JV a (s)e st ds 


for t < 0 
for t > 0 


(10.7) 


where T is a contour in the counterclockwise sense made up of the part of the circle ,v = ReJ° to the 
left of line s — C and the segment of the line s — C that overlaps the circle, as depicted in Fig. 10.2, 
and C and R are sufficiently large to ensure that F encloses all the finite poles of V 0 (s). 

From the residue theorem (see Sec. A.7), the contour integral in Eq. (10.7) can be evaluated as 


1 

2nj 



( 10 . 8 ) 


where P is the number of poles in V„(s). 

Note that if the numerator degree of the transfer function is equal to the denominator degree, 
then condition (ii) above is violated and the inversion technique described cannot be applied. However, 
the problem can be readily circumvented by expressing V a (s) as 


Vo(s) =Roo+ V'/s) 


Roo — lim T(j) 

S^-OO 


where 
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Figure 10.2 Contour f for the evaluation of the inverse Laplace transform. 


As can be readily verified, in such a case 


= V 0 (s) - Roo 

would satisfy conditions (i) and (ii) above and thus the inverse Laplace transform of Y(s) can be 
obtained as 


Vo(t)= Room + ^'V' 0 (S) 

The simplest way to obtain the time-domain response of a filter is to express H(s)Vj(s ) as a partial- 
fraction expansion and then invert the resulting fractions individually. If V„(s) has simple poles, we 
can write 


p 

Vo(s) — Roo + 

i = l 



(10.9) 


Ri = lim [(.? - pi) V 0 (j)] 

S^Pi 


where R a 0 is a constant and 
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is the residue of pole ,v = /;,. On applying the inversion formula in Eq. (10.7) to each partial fraction, 
we obtain 


p 

v 0 (t) = Roo8(t) + u{t)Y J Rie p ‘' (10.10) 

i=i 

where 8(t) and u.(t ) are the impulse function and unit step, respectively. 

The impulse response h(t ) of an analog system, that is, C~ 1 //(v), is of as much importance 
as the impulse response of a discrete-time system since its absolute integrability is a necessary and 
sufficient condition for the stability of the system. In discrete-time systems, the absolute summability 
of the impulse response imposes the condition that the poles of the transfer function be located inside 
the unit circle. Similarly, the absolute integrability of the impulse response in analog systems imposes 
the condition that the poles of the transfer function be located in the left-half s plane. 

Sometimes the unit-step response of an analog system may be required (see Prob. 11.9, for 
example). The Laplace transform of the unit step, u(t), is I / s. Hence the unit-step response is obtained 
as 


, H(s) 

v a (t) = Unit) = C~ l —— 
s 

In certain applications, it may be necessary to deduce the initial or final value of a signal from 
its Laplace transform (see Sec. 11.3, for example). Given the Laplace transform X(s) of a right-sided 
signal x(t), the initial and final values of the signal can be obtained as 

x(0+) = lim[5Z(s)] 


and 


lim x(t) = lim[.?X(s)] 

t —>oo s-^-0 


10.2.5 Frequency-Domain Analysis 

The sinusoidal response of an analog filter can be obtained 

v 0 (t) = C~ l [H{s)V i {s )] 


where 


AG) = C[u(t) sin&>f] = - 

(s + ju>){s - jco) 

Through an analysis similar to that found in Sec. 5.5.1, it can be shown that the sinusoidal 
response of an analog filter comprises a transient and a steady-state component (see Prob. 10.1). If the 
analog filter is stable, 1 i.e., the poles of the transfer function are in the left-half ,v plane, the transient 


1 Of course passive RLC analog filters cannot be unstable for the same reason that a piano note cannot persist forever 
but there are active analog filters that can become unstable. 
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component approaches zero as t is increased and eventually the response of the filter assumes a 
steady state of the form 


v a (t) — M(a>) sin[tt>f + 9{co)] 


( 10 . 11 ) 


where 


M(co) — \H(jco)\ and 6(co) — arg H(jco) 

are the gain and phase shift of the filter. As functions of frequency M(u>) and 0(o>) are the amplitude 
and phase response, respectively, and function 

H(jco) = M{co)e je(lo) 


which includes both the amplitude and phase responses, defines the frequency response. 

Given an arbitrary filter characterized by a transfer function such as that in Eq. (10.5) with M 
simple zeros and N simple poles, we can write 


H(joj) = M(oj)e m ° }) = 


H^ijco-Zi) 

n,=i(> - Pi) 


( 10 . 12 ) 


By letting 


ja> — Zi — M z .e^ z ‘ and jw — p, = M p .e^ Pi 


we obtain 


and 


M(w) = 


n Lm pi 


M N 

9(co) = arg H 0 + ^ f z . - ^ i// Pi 

i=l ; = 1 


(10.13) 


(10.14) 


where arg Hq — ic if Ho is negative. Thus the amplitude and phase responses of an analog filter can 
be determined by evaluating the transfer function on the imaginary axis of the s plane, as illustrated 
in Fig. 10.3. 

As in discrete-time systems the group delay is defined as 


r (&>) = 


dO(co) 

dco 


and as a function of frequency r(&>) is said to be the delay characteristic. 

The approximation methods to be presented in this chapter have evolved hand in hand with 
realization methods for passive RLC analog filters such as that in Fig. 10.1. On the basis of energy 
considerations, M ( co) is always equal to or less than unity in these filters and thus the gain in dB 
is always equal to or less than zero. For this reason, the past literature on passive analog filters has 
been almost entirely in terms of the loss (or attenuation) A(co) which is always equal to or greater 
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than zero since it is defined as the reciprocal of the gain in dB. The loss can be expressed as 


where 


A(co ) = 20 log 


Vi(jco) 


V 0 (ja>) 
L(« 2 ) = 


= 20 log 


1 


1 


= 10 log L(ar) 


H(jco)H(-jco ) 


A plot of A{co) versus co is often referred to as a loss characteristic. 
With co — s/j in Eq. (10.15), the function 


L{-s 2 ) 


D(s)D(-s) 

N(s)N(-s) 


(10.15) 


can be formed. This is called the loss function of the filter, and, as can be easily verified, its zeros 
are the poles of H(s ) and their negatives, whereas its poles are the zeros of // (s) and their negatives. 
Typical zero-pole plots for H(s ) and L(—s 2 ) are shown in Fig. 10.4. 


10.2.6 Ideal and Practical Filters 

The solution of the approximation problem for analog filters is facilitated by stipulating the existence 
of a set of idealized filters that can serve as models. An ideal lowpass filter is one that will pass 
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X 2 
X 2 



Figure 10.4 Typical zero-pole plots for H(s) and L(—s 2 ). 


only low-frequency and reject high-frequency components. Such a filter would have zero loss in 
its passband and infinite loss in its stopband as depicted in Fig. 10.5 a. The boundary between the 
passband and stopband, namely, co c , can be referred to as the cutoff frequency. Highpass, bandpass, 
and bandstop filters with loss characteristics like those depicted in Fig. 10.5£> to d can similarly be 
defined. 


A{u>) 


A(co) 


(O c OJ 

(a) 


°>c " 

(b) 


A(co) 


A(w) 


v c2 


(C) 


(d) 


Figure 10.5 Ideal loss characteristics: (a) Lowpass, (b) highpass, (c) bandpass, (d) bandstop. 
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A practical lowpass filter differs from an ideal one in that the passband loss is not zero, the 
stopband loss is not infinite, and the transition between passband and stopband is gradual. The loss 
characteristic might assume the form shown in Fig. 10.6a where a> p is the passband edge, co a is the 
stopband edge, A p is the maximum passband loss, and A a is the minimum stopband loss. The cutoff 
frequency a> c is usually a loose demarcation boundary between passband and stopband, which can 
vary from the one type of approximation to the next usually on the basis of convenience. For example, 
it is often used to refer to the 3-dB frequency in Butterworth filters or the square root of m p u> a in the 
case of elliptic filters. Typical characteristics for practical highpass, bandpass, and bandstop filters 
are shown in Fig. 10.6£> to d. 



(a) 



(b ) 


Figure 10.6 Nonideal loss characteristics: (a) Lowpass, (b) highpass. 
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(C) 



id) 

Figure 10.6 Cont’d Nonideal loss characteristics: (c) Bandpass, ( d ) bandstop. 


10.2.7 Realizability Constraints 

An analog-filter approximation is a realizable continuous-time transfer function such that the loss 
characteristic approaches one of the idealized characteristics in Fig. 10.5. A continuous-time transfer 
function is said to be realizable if it characterizes a stable and causal network. Such a transfer function 
is required to satisfy the following constraints: 

1. It must be a rational function of .v with real coefficients. 

2. Its poles must lie in the left-half s plane. 

3. The degree of the numerator polynomial must be equal to or less than that of the denominator 
polynomial. 
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In the following four sections, we focus our attention on normalized lowpass approximations; 
namely, Butterworth approximations in which the 3-dB cutoff frequency co c is equal to 1 rad/s, 
Chebyshev approximations in which the passband edge co p is equal to 1 rad/s, inverse-Chebyshev 
approximations in which the stopband edge co a is equal to 1 rad/s, elliptic approximations in which 
the cutoff frequency ao c = \](o> p oj a ) is equal to 1 rad/s, and Bessel-Thomson approximations in 
which the group delay as oo —> 0 is equal to 1 s. Normalization keeps the sizes of numbers around 
unity which are easier to manage. Approximations for real-life practical filters can be obtained from 
the normalized ones through the use of transformations as described in Sec. 10.8. Approximations 
so obtained are sometimes said to be denormalized. 

10.3 BUTTERWORTH APPROXIMATION 

The simplest lowpass approximation, the Butterworth approximation, is derived by assuming that 
L(a> 2 ) is a polynomial of the form 

L(or) = b 0 + bico 2 + • • • + b,,co 2n (10.16) 

such that 

lim L(a> 2 ) — 1 

io 2 ^ 0 


10.3. 


in a maximally flat sense. 

1 Derivation 

The Taylor series of L(x + /;), where x = co 2 , is 


dL(x) 

L(x + h) — L(x) + h -b 

dx 


h k d k L(x ) 
k\ dx k 


The polynomial L(x) approaches unity in a maximally flat sense as x 
are zero at x = 0. We may, therefore, assign 


0 if its first /? — 1 derivatives 


L( 0) = 1 


d k L(x) 

dx k 


x=0 


= 0 


Thus from Eq. (10.16), we have 


for k < n — 1 


bo — 1 and b\ = bz — ■ ■ ■ = b n ~\ — 0 


or L{co 2 ) = 1 + b n co 2n 

Now, for a normalized approximation in which 

L(l) = 2 

that is, A(co) & 3dB at to = 1 rad/s, b n — 1 and 

L(a?) = 1 + co 2 " 


(10.17) 
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Figure 10.7 Typical Butterworth loss characteristics (n = 3, 6, 9). 


Hence, the loss in a normalized lowpass Butterworth approximation is 

A(co) = 10 log (1 + co 2n ) 

This is plotted in Fig. 10.7 for n = 3, 6, 9. 


10.3.2 Normalized Transfer Function 

With co — s/j in Eq. (10.17), we have 


2 n 


L(—s 2 ) = 1 + (-s 2 )" = l[(s - Zi ) 


i=i 


' e j(2i-l)n/2n f Qr 


even n 


Zi 


t 


j(i-l)n/n 


for odd n 


and since |z* | = 1, the zeros of L(—s 2 ) are located on the unit circle ,v 
The normalized transfer function can be formed as 


= 1 . 


H n (s) = 


1 


n;=,cs- - Pl ) 


(10.18) 


(10.19) 


where p, for i = 1,2, ... ,n are the left-half .v-plane zeros of L(—s 2 ). 
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Example 10.1 


Using the Butterworth approximation, find Hn(s) for (a) n — 5 and (b) n 


= 6 . 


' Solution 

(a) Forn = 5, Eq. (10.19) gives 


Zt = e i(i ~ 1)71,5 


— cos 


(i — 1 )jt 


(i — 1)7r 

j sin 


5 5 

Hence, the zeros of the loss function are as follows: 

ZI = 1.0 z 2 = 0.809017 + y'0.587785 
z 3 = 0.309017 + y'0.951057 z 4 = -0.309017 + y'0.951057 
z 5 = -0.809017 + y'0.587785 z 6 = -1.0 

z 7 = -0.809017 - y'0.587785 z 8 = -0.309017 - y'0.951057 

z 9 = 0.309017 - y'0.951057 z 10 = 0.809017 - y'0.587785 

Dropping the right-hand j- plane zeros of the loss function, we get 

z 4 = -0.309017 + y'0.951057 z 5 = -0.809017 + y'0.587785 
z 6 = -1.0 z 7 = -0.809017 - y'0.587785 
z 8 = -0.309017 -y'0.951057 

Now if we combine complex conjugate pairs of poles into factors, we obtain 
1 1 

H(s)= 


(s+1) (s + 0.309017 -y'0.951057)(s + 0.309017 + y'0.951057) 

1 

' (s + 0.809017 - y'0.587785)(s + 0.809017 + y'0.587785) 

1 1 1 


(s+ 1) (x 2 + 0.618034^ + 1) (s 2 + 1.618034x+ 1) 
(b) Similarly, for n — 6, we have 


Zi = e f< 2, ' _1 H/2n 


(2 i — 1) 7T 
12 


(2 i — 1) 7T 

/' sin- 

J 12 


Hence 


zi = 0.965928 4- y'0.258819 z 2 = 0.707107 4- y'0.707107 

z 3 = 0.258819 + y0.965926 z 4 = -0.258819 4- y'0.965926 
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z 5 = -0.707107 + j'0.707107 
zi = —0.965928 — j'0.258819 
z 9 = -0.258819 -;0.965926 
zu = 0.707107-y0.707107 


z 6 = -0.965928 + jO.258819 
Z8 = -0.707107-70.707107 
zio = 0.258819 - 70.965926 
zu = 0.965928 - 7'0.258819 


Dropping the right-hand s plane zeros of the loss function, we get 


z 4 = -0.258819 + 70.965926 z 5 = -0.707107 + 70.707107 

z 6 = -0.965928 + 70.258819 z 7 = -0.965928 - 70.258819 

z 8 = -0.707107 - 70.707107 z 9 = -0.258819 - 70.965926 

Now if we combine complex conjugate pairs of poles into factors, we obtain 

1 

H(S) ~ (s + 0.258819 - 7'0.965926)(s + 0.258819 + 70 . 965926 ) 

1 

' (s + 0.707107 - 70 .707107)(,j + 0.707107 + y0.'707107) 

1 

' (s + 0.965928 - 70 . 258819)(5 + 0.965928 + 70 . 258819 ) 

1 1 
~ (i 2 + 0.5176385 + 1) ’ (s 2 + 1.4142145 + 1) 

1 

'(5 2 + 1.9318525 + 1) " 

The zero-pole plots of the loss function for the two examples are shown in Fig. 10.8. 




Figure 10.8 Zero-pole plots of loss function L(—s 2 ) (Example 10.1). 
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10.3.3 Minimum Filter Order 

Typically in practice, the required filter order is unknown. However, for Butterworth, Chebyshev, 
inverse-Chebyshev, and elliptic filters it can by easily deduced if the required specifications are 
known. 

Let us assume that we need a Butterworth filter with a maximum passband loss A p , minimum 
stopband loss A a , passband edge co p , and stopband edge co a . As can be seen in Fig. 10.7, the loss in 
the Butterworth approximation is a monotonic increasing function, and thus the maximum passband 
loss occurs at the passband edge. Hence, we have 

A(oJ p ) = 101og(l + co 2 p) < A p 


Thus 


1 + 0 % < 10^ /10 

OT p " < 10 ° 1A '’ - 1 
2n\oga> p < log(10 0 ' 1Ap — 1) 

For (D p < 1 and A p < 3.01 dB, both sides in the above inequality are negative and if we express the 
above relation as 


— 2n\o°(o p > — log(10 0 ' 1Ap — 1) 


both sides will be positive. Solving for n, we get 

[— log(10 01A '’ - 1)] 

n > - 

( — 2 log (Dp) 


( 10 . 20 ) 


Similarly, the minimum stopband loss occurs at the stopband edge. Hence, n must be large enough 
to ensure that 


A(u> a ) = 10 log (l + cd 2 ") >A a 


Solving for n, we get 


log(10 01A “ - 1) 

n > - 

2 log (D a 


( 10 . 21 ) 


In practice, we must, of course, satisfy both the passband and stopband specifications and, therefore, 
n must be chosen large enough to satisfy both Eq. (10.20) as well as Eq. (10.21). 

It should be mentioned here that Eqs. (10.20) and (10.21) will not normally yield an integer 
but since the filter order must be an integer, the outcome of Eqs. (10.20) and (10.21) must be rounded 
up to the nearest integer. As a result of this rounding-up operation, the required specifications will 
be slightly oversatisfied. The actual maximum passband loss and actual minimum stopband loss 
can be found by evaluating the loss of the filter at the specified passband and stopband edges using 
Eq. (10.18). 
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Example 10.2 


In an application a normalized Butterworth lowpass filter is required that would 
satisfy the following specification: 


• Passband edge a> p : 0.7 rad/s 

• Stopband edge co a : 2.0 rad/s 

• Maximum passband loss A p : 0.5 dB 

• Minimum stopband loss A a : 30.0 dB 


(a) Find the minimum filter order that would satisfy the specifications. ( b ) Calculate the actual 
maximum passband loss and minimum stopband loss, (c) Obtain the required transfer function. 


■ Solution 

(a) To ensure that the passband loss is equal to or greater than A p = 0.5 dB the inequality 
in Eq. (10.20) must be satisfied, i.e., 

[-log(10 aL4 ' - 1)] 

n > - 

(-2 log (o p ) 

^ [— log(10 01 * 0 ' 5 - 1)] 

- (-2 log 0.7) 

> 2.9489 3 

To ensure that the stopband loss is equal to or greater than A a = 30.0 dB, Eq. (10.21) 
must be satisfied, i.e., 


log(10 01A ° - 1) 

n > - 

2 log co a 

^ log(10 01 * 30 - 1) 

21 2 log 2.0 

> 4.9822 -* 5 

In order to satisfy the passband as well as the stopband specifications, we choose the 
order n to be the larger of 3 and 5, that is, n = 5. ■ 

( b) Because of the monotonic increasing nature of the loss of the Butterworth approxima¬ 
tion, the actual maximum passband loss occurs at the passband edge. Hence, Eq. (10.18) 
gives 


A(co p )= 10log (1 +co 2 p n ) = 101og(l +0.7 10 ) = 0.1210 dB ■ 
Similarly, the actual minimum stopband loss occurs at the stopband edge and thus 
A(oo a )= 10log (1 +co 2 a n ) = 10log(1 + 2.0 10 ) = 30.11 dB ■ 
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The Butterworth method, like the Bessel-Thomson method to follow, yields only one 
approximation for each filter order and, therefore, the required transfer function is the 
one found in Example 10.1, part (a). 


10.4 CHEBYSHEV APPROXIMATION 

In the Butterworth approximation, the loss is an increasing monotonic function of co, and as a result 
the passband characteristic is lopsided, as can be seen in Fig. 10.7. A more balanced characteristic 
can be achieved by employing the Chebyshev 2 approximation in which the passband loss oscillates 
between zero and a prescribed maximum A p . In effect, the Chebyshev approximation leads to a 
so-called equiripple solution. 

10.4.1 Derivation 

The loss characteristic in a fourth-order normalized Chebyshev approximation is of the form illus¬ 
trated in Fig. 10.9, where a> p — 1. The loss is given by 

A(co) — 10 log L(a> 2 ) (10.22a) 



Figure 10.9 Loss characteristic of a fourth-order normalized Chebyshev filter. 


-Pafnuty Lvovitch Chebyshev (1821-1894) was a Russian mathematician who was born in Okatovo, a small town west 
of Moscow. In addition to his famous contribution to approximation theory, he contributed to number theory, integration, and 
probability theory, and studied the convergence of the Taylor series. 
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where 


L(a> 2 ) = 1 +s 2 F 2 (co) (10.22b) 

and 

e 2 = 10°' 1Ap - 1 (10.23) 

Fim), L(oo 2 ), and in turn L(—s 2 ) are polynomials, and hence the normalized transfer function is of 
the form 


H n (s) = 


Hp 
D(s) 


where Hq is a constant. 

The derivation of H^is) involves three general steps: 


1. The exact form of Fim) is deduced such that the desired loss characteristic is achieved. 

2. The exact form of Liar) is obtained. 

3. The zeros of L(—s 2 ) and, in turn, the poles of H N is) are found. 


Close examination of the Chebyshev loss characteristic depicted in Fig. 10.9 reveals that F{co) 
and Liar) must have the following properties: 


Property 1: Fia>) = 0 
Property 2: F 2 ito) = 1 
dLico 2 ) 

Property 3: -= 0 

J dm 


if m — i£2oi, if 2 o 2 
if m — 0, , ±1 

if m — 0, , ±£ 2(52 


From Property 1, Fim) must be a polynomial of the form 


Fim) = Mi (m 2 - £2^) ( m 2 - £25 2 ) 

(M \, M 2 ,..., Mj represent miscellaneous constants in this analysis.) From Property 2, 1 — F 2 im) 
has zeros at m = 0, ±£2i, ±1. Furthermore, the derivative of 1 — F 2 im) with respect to m, namely. 


dm 


[1 - F 2 im)] = -2Fim) 


dFim) 

dm 


1 dLim 2 ) 
e 2 dm 


(10.24) 


has zeros at m = 0, ±£2oi, ±f2|, ±£2o2, according to Property 3. Consequently, 1 
at least double zeros at m = 0, ±C [. Therefore, we can write 


F-(o>) must have 


1 - F 2 im) = M 2 m 2 {m 2 - £^) 2 (« 2 - 1) 
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Now from Eq. (10.24) and Properties 1 and 3, we get 



By combining the above results, we can form the differential equation 


dF(co) 

da> 


M 4 ( 1 - f 2 (®)] 
1 — a> 2 


(10.25) 


which is the basis of the fourth-order Chebyshev approximation. 

The reader who is more interested in applying the Chebyshev approximation and less in its 
derivation can proceed to Sec. 10.4.3 where the general formulas for the nth-order Chebyshev 
approximation can be found. 

To continue with the derivation, Eq. (10.25) can be expressed in terms of definite integrals as 



Hence, F and <>> are interrelated by the equation 


M 5 cos 1 F + Mi = cos 1 a> = 9 


(10.26) 


i.e., for a given value of 9 



a> — cos 9 and F = cos 


What remains to be done is to determine constants Ms and Mj. If to = 0. then 9 — ?r/2; and 
if a> = 1, then 0 = 0, as depicted in Fig. 10.10. Now, F will correspond to F(a>) only if it has two 
zeros in the range 0 < 9 < jt/2 (Property 1), and its magnitude is unity if 0 = 0, n/2 (Property 2). 
Thus F must be of the form illustrated in Fig. 10.10. As can be seen, for 0 = 0 



or Mi = 0. In addition, one period of F must be equal to one-quarter period of a>, that is, 


2nMs 


■ 


2 


1 

or = - 

4 


Therefore, the exact form of F(co) can be obtained from Eq. (10.26) as 


F(a>) = cos(4cos 1 a>) 


Alternatively, by expressing cos 49 in terms of cos 9, F(a>) can be put in the form 


F(a j) = 1 - 8 <w 2 + 8« 4 
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Figure 10.10 Plots of a> and F versus 9. 


This polynomial is the fourth-order Chebyshev polynomial and is often designated as 74 (a )). 3 
Similarly, for an nth-order Chebyshev approximation, one can show that 

F(co) = T n (co) = cos (n cos -1 a>) 


and hence from Eq. (10.22b) 


L(co 2 ) = 1 + £ 2 [cos(« cos 1 a ))] 2 (10.27) 

This relation gives the loss characteristic for |o>| < 1. For \oo\ > 1, the quantity cos -1 o> becomes 
complex, i.e.. 


cos 1 co — j9 


(10.28) 


and since 


co — cos jO 




we have 


9 = cosh 1 co 


3 The use of T n for the representation of Chebyshev polynomials has to do with the German spelling of the great 
mathematician’s name, i.e., Tchebyschejf [2], which does not appear to be in use nowadays. 
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Now from Eq. (10.28) 

cos -1 co — j cosh -1 co 

and 

cos(n cos -1 co) — cos ( jn cosh -1 co) = cosh(n cosh -1 co) 

Thus for \a>\ > 1, Eq. (10.27) becomes 

L(co 2 ) = 1 + e 2 [cosh(n cosh -1 co)] 2 (10.29) 


In summary, the loss in a normalized lowpass Chebyshev approximation is given by 

A(co) = 10 log [1 + e 2 T 2 (co)\ (10.30) 


where 


T„(co) = 


cos (n cos 1 co) 
cosh(n cosh -1 co) 


for \co\ < 1 
for \co\ > 1 


The loss characteristics for n = 4, A p = 1 dB and n = 7, A p — 0.5 dB are plotted in 
Fig. 10.11a. As can be seen 


A(0) = 



for even n 
for odd n 


as is generally the case in the Chebyshev approximation. 

As an aside, note that in Fig. 10.1 la the number of stationary points is exactly equal to the order 
of the approximation, that is, 4 or 7 for a fourth- or seventh-order approximation. This is a general 
property of the Chebyshev approximation which is imposed by the formulation of the approximation 
problem. 


10.4.2 Zeros of Loss Function 

With co = s/j, Eq. (10.29) becomes 


L(-s 2 ) = 1 + £ 2 


and if si = 07 + jcot is a zero of L(—s 2 ), we can write 


cosh f n cosh 1 


J 


+ jVi = COSh \~j(Ti + COi) 


cosh[n(i</ + jv^] = ±- 
s 


(10.31a) 

(10.31b) 


From Eq. (10.31a) 


— j <jj + cot — cosh(M,- + jVi) — cosh iij cos Vi + j sinhM; sini),- 




Loss, dB Loss, dB 


486 DIGITAL SIGNAL PROCESSING 



(a) 



(b) 


03 

"O 

c/T 

o 

H-l 


Figure 10.11 (a) Typical loss characteristics for Chebyshev filters (n = 4, A p = 1.0 dB and n = 7, 

A p = 0.5 dB), ( b ) typical loss characteristics for inverse-Chebyshev filters (n = 4, A a = 40 dB and n = 7, 
A a = 50 dB). 
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or 


and 


ay = — sinh sin v. 


(10.32) 


a), = cosh u j cos Vt 


(10.33) 


Similarly, from Eq. (10.31b) 


coshnw; cos nvi + j sinh nuj sinni); = ± — 

s 


or 


coshnw, cos nv, = 0 


and 


1 

sinhnM,- sinnu; = ±- 


s 


(10.34a) 


(10.34b) 


The solution of Eq. (10.34a) is 


(2 i - 1 ) 7T 
2 n 


for i = 1 , 2 , 


and since sin(mi,) = ±1, Eq. (10.34b) yields 

1 1 

m = u = ±— sinh - 
n s 

Therefore, fromEqs. (10.32), (10.33), (10.35a), and (10.35b) 


, • U1 1 • ,_i ^ • (2* - l)7i 

Oi = ± sinh I - sinh — | sin--- 


a>i = cosh ( — sinh 

n s 


1\ (2/ — 1 )7T 


COS 


2 n 


for i = 1,2 ,,n. Evidently, 


cor 


sinh 2 u cosh 2 u 


= 1 


(10.35a) 


(10.35b) 


(10.36a) 

(10.36b) 


i.e., the zeros of L(—s 2 ) are located on an ellipse, as depicted in Fig. 10.12. 







.9 Ul£./' S Ul£f 
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Vies 

(a) 



-0.5 0 0.5 

(b) 


Figure 10.12 Zero-pole plot of L(—s 2 ) for Chebyshev filter: (a) n = 5, A p = 1 dB, (b) n = 6, A p = 1 dB. 







































APPROXIMATIONS FOR ANALOG FILTERS 489 


10.4.3 Normalized Transfer Function 

The normalized transfer function H N (s ) can at this point be formed by identifying the left-half 
j-plane zeros of the loss function, which happen to be the poles of the transfer function, as 


H n (s) = 


_ Ho _ 

D(s)l%{s - p,)(s - pf) 


_ Ho _ 

D(s)Yl r i[s 2 -2V\e( Pi )s + \ Pi f] 


(10.37a) 

(10.37b) 


where 


' n — 1 


r = 


2 

n 


u 


for odd n 
for even n 


and 



for odd n 
for even n 


The poles and multiplier constant, Hq, can be calculated by using the following formulas in sequence: 


e = \J lO 01 ' 4 ' 1 — 1 


(10.38) 


with 


with 


and 


P0 = CT(„ + i)/2 


(10.39) 


cr ( „+ 1)/2 = - sinh 


- sinh 1 
n 


(10.40) 


Pi = a , + ja>i for i = 1, 2, ... , r 


(l ! IN . (2l - 1 )TV 

<7; = — sinh - srnh - sin- 

\n s J 2 n 


u ( 1 • u _l ^ (2/ - 1)7T 

a>i = cosh — sinh - cos- 

\n e) 2 n 


(10.41) 

(10.42a) 

(10.42b) 


Ho 


-PoYl'i=\ \Pi\ 2 for odd n 

2q-o.05A p J|' =i | p t | 2 for even n 


(10.43) 


In the above formulation, constant Hq is chosen to yield zero minimum passband loss. Formulas 
for the required hyperbolic functions and their inverses can be found in Sec. A.3.4. 
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Example 10.3 


Obtain a fourth-order normalized Chebyshev approximation assuming a max¬ 
imum passband loss of A p = 1.0 dB. 


> Solution 

From Eq. (10.23) 


1 _ 1 

£ ~ X ~ VlO 01 - 1 


= 1.965227 


and 


sinlT 1 - = ln(;t + \J x 1 + 1) = 1.427975 


Hence, Eqs. (10.42a) and (10.42b) give 


(2 i - 1) 7T 

a, = -0.364625 sin --— 

8 


C 0 i = 1.064402 cos 


(2 i - l)jr 

8 


and from Eqs. (10.41) and (10.43), the poles and multiplier constant can be obtained as 

pi, p* = -0.139536 ± y'0.983379 

p 2 . Pi = -0.336870 ± y'0.407329 

2 

H 0 = 10-° 05xl Y[ \Pi\ 2 = 0.245653 
! = 1 

Since Dq(s) — 1 for an even-order Chebyshev approximation, Eq. (10.37b) gives the 
required transfer function as 


H n (s) = Hoi 


1 


1 , s 2 + bus + b 0 i 
1 = 1 


where 


b 0l = 0.986505 b „ = 0.219012 

b 02 = 0.279398 b n = 0.673740 


10.4.4 Minimum Filter Order 

In a normalized lowpass Chebyshev transfer function, the passband edge is fixed at co p = 1 rad/s and 
an arbitrary maximum passband loss A p dB can be achieved. Since the stopband loss is an increasing 
monotonic function of frequency as can be seen in Fig. 10.1 la, the minimum stopband loss occurs 
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at the stopband edge. From Eq. (10.30), we have 

A(a> a ) = 10log [1 + s 2 T^co a )] 

= lOlog {l + e 2 [cosh (n cosh -1 co a )]"} 
Since the minimum stopband loss must be equal to or exceed A a , we have 

10log{1 + e 2 [cosh(n cosh -1 <y a )] 2 } > A a 

1 + e 2 [cosh(n cosh -1 u > a )] 2 > 10 01Afl 

Vl0°- M « - : 
cosh(«cosh co a ) > - 


and on eliminating e using Eq. (10.23) and then solving for n, we obtain 

cosh -1 a/D 


where 


n > 


D = 


cosh 1 a>„ 


10 01A - - 1 


10 °- 


1 A„ 


1 


(10.44) 


(10.45a) 


(10.45b) 


The required filter order is the lowest integer that would satisfy the above inequality. Once the filter 
order is determined, the actual minimum stopband loss can be obtained by substituting back the filter 
order in Eq. (10.44). 


Example 10.4 


An application calls for a normalized lowpass Chebyshev filter that would 
satisfy the following specifications: 


• Passband edge co p : 1.0 rad/s 

• Stopband edge co a \ 2.0 rad/s 

• Maximum passband loss A p : 0.1 dB 

• Minimum stopband loss A a : 34.0 dB 


(a) Find the minimum filter order. ( b ) Obtain the required transfer function, (c) Calculate the 
actual minimum stopband loss. 

■ Solution 

(a) From Eq. (10.45b) 


D = 


10 ' 


,0.1x34 


1 


10 ° ixo.i _ ! 

Hence, Eq. (10.45a) gives 

cosh -1 Vl.077958 x 10 5 


= 1.077958 x 10 5 


n > 


cosh 1 2.0 


= 4.93 
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(. b ) From Eq. (10.38), we have 

s = x/lO 01 * 01 - 1 = 0.152620 or - = * = 6.552203 

£ 

and sinh -1 - = In (a + \J x 2 + 1) = 2.578722 

e 

From Eqs. (10.40) and (10.41), we get 

o -3 = -0.538914 


and 


(2 i — 1)7T 

cr; = -0.5389143 sin 


a>i = 1.135970 cos 


10 

(2 i — 1)tt 

To 


Thus Eqs. (10.39), (10.41), and (10.43) give the poles and multiplier constant as 


po = -0.538914 

p u p*i = -0.166534 ± j 1.080372 

p 2 , p* 2 = -0.435991 ± 70.667707 

2 

Ho = -p o niAl 2 = °. 40951 3 
1=1 

Therefore, from Eq. (10.37b) the required transfer function is obtained as 

Ho 7r 1 

H n (s) = -TT -a- ■ 

^ + b 00 15,2 + buS + 

where 

boo = 0.538914 

hoi = 1.194937 b u = 0.333067 
b 02 = 0.635920 b l2 = 0.871982 


(c) The actual minimum stopband loss can be obtained by evaluating the stopband loss 
at the stopband edge using the actual filter order. From Eq. (10.44), we get 

A(w a ) = 10log{1 + (0.152620) 2 [cosh(5 cosh -1 2.0)] 2 } = 34.85 dB ■ 
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10.5 INVERSE-CHEBYSHEV APPROXIMATION 


A closely related approximation to the above is the inverse-Chebyshev approximation. This can 
actually be derived from the Chebyshev approximation but the derivation is left as an exercise to the 
reader (see Prob. 10.12). The passband loss in the inverse-Chebyshev is very similar to that of the 
Butterworth approximation, i.e., it is an increasing monotonic function of a>, while the stopband loss 
oscillates between infinity and a prescribed minimum loss A „, as depicted in Fig. 10.1 I b. The loss 
is given by 


where 


A(a>) = 10 log 


1 

1 + 8^ff(\/co)_ 


8 2 


1 

10 01A ° - 1 


(10.46) 


(10.47) 


and the stopband extends from co = 1 to oo. 


10.5.1 Normalized Transfer Function 

The normalized transfer function has a number of zeros on the jco axis in this case and is given by 


where 


and 


^)=^n (5 “ 1/zi)(s “ 1/zr) 


OoCv) f = \ (s - 1 /p,)(s - 1/p?) 


Ho 

Do(s) 

H 0 

Do(s) J 


n 




i= 1 S" 


2$He 


(i) 


^ + 


\Pi \ 2 


ni 

= 1 S 2 


s2+ RTF 


2 5Be 


(i) 


5 + 


IaI 2 


r = 



for odd n 
for even n 


D 0 (s) = 



for odd n 
for even n 


(10.48a) 

(10.48b) 


(10.48c) 


(10.48d) 


(10.48e) 


If the filter order n and minimum stopband loss A a are known, the multiplier constant Ho and 
zeros and poles or transfer function coefficient can be obtained by using the following formulas in 
sequence: 

1 

3 = , 

Vio 01A “ -1 


(10.49) 
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with 


with 


and 


Zi = J cos 


Po = cr (n+l)/2 


(2 i - 1)tt 


a (n+ 1)/2 


2 « 


1 


for 1, 2, .., 4 r 


= — sinh I - sinh 1 - 


Pi = (Zi + jcoi 


a-, = — sinh ( - sinh — ) sin 
. n 


for 1, 2./- 


1 \ . ( 2 i - \)tx 


, 1 

CO; = cosh — sinh 


H 0 = 


cos 


1 TT' 

-Pa 11/=1 


2 n 

( 2 / - 1 )7T 

2n 

for odd n 


-pa \Pi\'~ 

for even n 

The derivation of H^(s) is left as an exercise for the reader (see Prob. 10.9). 


rr 

ll/=i \ Pi \ 2 


(10.50) 

(10.51) 

(10.52) 

(10.53) 
(10.54a) 
(10.54b) 

(10.55) 


10.5.2 Minimum Filter Order 


In a normalized lowpass inverse-Chebyshev transfer function, the stopband edge is fixed at a> a = 1 
rad/s and an arbitrary minimum stopband loss A a dB can be achieved for any given order. The min¬ 
imum filter order is thus determined by the maximum loss allowed in the passband, namely, A p dB. 
The highest passband loss occurs at the passband edge and from Eq. (10.46) 


A(co p ) = 10 log 


1 

/ + 8 2 T^(l/a> p ) 


= 10 log 



1 

<$ 2 [cosh(n cosh -1 1 /co p )] 2 


(10.56) 


Hence, the minimum filter order must satisfy the inequality 

1 


10 log 

and if we solve for n, we obtain 


1 + 


5 2 [cosh (ncosh 1 \/a> p )} 2 


< A„ 


where 


cosh 1 a/D 
cosh -1 (l/®p) 

10 01A “ - 1 
" 10 01A o - 1 


(10.57a) 


(10.57b) 


The minimum filter order is the lowest integer that would satisfy the above inequality. The actual 
maximum passband loss can be obtained by substituting the filter order obtained back in Eq. (10.56). 
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Example 10.5 


An application requires a normalized lowpass inverse-Chebyshev filter that 
would satisfy the following specifications: 


• Passband edge a> p : 0.6 rad/s 

• Stopband edge u> a \ 1.0 rad/s 

• Maximum passband loss A p : 1.0 dB 

• Minimum stopband loss A a : 35.0 dB 


(a) Find the minimum filter order. ( b ) Obtain the required transfer function, (c) Calculate 
the actual maximum passband loss. 


■ Solution 

(a) From Eq. (10.57b) 


jnO. 1x35.0 _ i 

D = „ -- = 1.2209 x 10 4 


lQ0.lxl.0_J 

Hence, Eq. (10.57a) yields 

cosh ' 1 V 1.2209 x 10 4 5.3981 


n > 


= 4.9136 


cosh ' 1 (JL) 1.0986 

( b ) From Eqs. (10.48d) and (10.48e), we have 

r = (n — l)/2 = 2 and D 0 (s) = s — i/po 


and from Eqs. (10.49)—(10.55), we get 

1 

8 = 


1Q0-1x35.0 _ 1 


= 0.017786 


,T 1 

(73 = — sinh - sinh - 

',5 0.017786 


Zi = j cos 


( 2 i - l)?r 
10 


/1 1 

a,- = — sinh - sinh - 

\5 0.017786 

( 2 ; - 1)jt 

= —1.091354 sin --— 

10 

(\ 1 

Co, = cosh - sinh - 

V 5 0.017786 


= -1.091354 


(2 i - 1)jt 
sin - 


10 


(2/ - 1)t r 
2 n 


= 1.480221 cos 


(2/ - 1 )tt 
10 
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Hence, 


P o 

Zl 

Z2 

P\ 


P 2 


0-3 = -1.091354 

j cos — = y'0.951057 
j 1Q j 

j COS — = y'0.587785 
j 1Q J 

— 1.091354 sin — + y 1.480221 cos — 
10 10 

-0.337247 + j 1.407774 


-1.091354 sin - - y1.480221 cos 
10 J 

-0.882924 + y'0.870052 


3tx 

To 


Therefore, the transfer function in Eq. (10.48c) assumes the form 

H o( s2 + j77p0( i2 + lip) 


H n (s ) = 


( 5 - JJ I s2 - 2me (j;) s + rfJ r - 2me d) s + 

H 0 (s 2 + a 0 i)(s 2 + a 02 ) 

(s + b 0 o)(s 2 + b n s + b 0 i)(s 2 + b 12 s + b 02 ) 


% 

\pi\ 2 


where 


1 


«oi = 

boo = 
boi = 
t>o 2 = 


Iztl 2 

1 

a 3 

1 

\Pi\ 2 


It»2| 2 

*=-n 

— On - L - L 


= 1.105573 

«02 = 

|Z 2] 2 

2.894427 

= 0.916293 




= 0.477199 

b \i = 

-2 IHe 

| = 0.321868 

= 0.650811 

b n = 

-2 me 

^ = 1.149232 


2 'z,l 2 


Pof = \ \Pi\~ 

= 0.088928 

(c) From Eq. (10.56), the maximum passband loss can be determined by evaluating the 
loss at the passband edge as 


A(a> p )= 10 log < 1 + 




1 


[ 0.017786 2 [cosh(5cosh- 1 ^)} 2 

= 0.8427 dB ■ 
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10.6 ELLIPTIC APPROXIMATION 

The Chebyshev approximation yields a much better passband characteristic and the inverse- 
Chebyshev approximation yields a much better stopband characteristic than the Butterworth ap¬ 
proximation. A filter with an improved passband as well as an improved stopband loss characteristic 
can be obtained by using the elliptic approximation in which the passband loss oscillates between 
zero and a prescribed maximum A p and the stopband loss oscillates between infinity and a prescribed 
minimum A a . 

The elliptic approximation is more efficient than the preceding two in that the transition between 
passband and stopband is steeper for a given approximation order. 

Our approach to this approximation follows the formulation of Grossman [9], which, although 
involved, is probably the simplest available. The approach taken is first to deduce the fifth-order 
approximation and then generalize the results obtained to the nth odd-order approximation. After 
that the nth even-order approximation is given without the derivation. The section concludes with 
a practical procedure for obtaining elliptic transfer functions that would satisfy prescribed filter 
specifications. 


10.6.1 Fifth-Order Approximation 


The loss characteristic in a fifth-order normalized elliptic approximation is of the form depicted in 
Fig. 10.13, where 

1 

0>c = s/VaMp = 1 


w p = Vk w a = — 


The constants k and k\ given by 


and 


k — 


COn 


k i = 


fl0 OAA » - 1 


1/2 


V io 01A « - i 

are the selectivity factor and discrimination factor, respectively. The loss is given by 


(10.58) 


A(&>) = 10 log L(&r) 


where 


L(a> 2 ) = 1 +e 2 F 2 (co) (10.59) 

and 

£ 2 = 10°' 1Ap - 1 (10.60) 

Function F(a>) and in turn L(of), L(—s 2 ), and ll(s), which are polynomials in the Chebyshev 
approximation, are ratios of polynomials in the case of the elliptic approximation. 

According to the elliptic loss characteristic of Fig. 10.13, the prerequisite properties of F(&>) 
and L(co 2 ) are as follows: 
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Figure 10.13 Loss characteristic of a fifth-order elliptic filter. 


Property 1: 
Property 2: 
Property 3: 

Property 4: 
Property 5: 


F(co) = 0 
F(co) — oo 
F 2 (co) = 1 

F2< " ) = p 

dLia/)J Q 

dco 


if CO — 0, if^02 

if CO — OO, zbf^ool , i^oo2 

if co = =hQi, i dk 

if CO — i £21, dzf22' i -jj 

if CO — i £2 1, i Ci.2 > i £21, i f^2 


By using each and every one of these properties we shall attempt to derive the exact form of F(co). 
The approach is analogous to that used earlier in the Chebyshev approximation. 4 
From Properties 1 and 2, we obtain 


F(co) = 


M\Cjo(ar — £2^) (<w 2 — £2 q 2 ) 

(® 2 - ^ oi )(« 2 - 


(10.61) 


4 The DSP practitioner who is more interested in applying the elliptic approximation and less so in its derivation may 
proceed to Sec. 10.6.6 for the outcome of this exercise in mathematics. 
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(Mi to M 7 represent miscellaneous unknown constants that arise in the formulation of the problem 
at hand). Similarly, from Properties 2 and 3, we can write 

l _ F 2 ( ■ M 2 (co 2 -0 2 ) 2 (c a 2 -Q 2 ) 2 {co 2 -k) 

(« 2 - ^) V - ^ 2 ) 2 

where the double zeros at co — ±Q|, ±Qi are due to Property 5 (see Sec. 10.4.1). Similarly, from 
Properties 2, 4, and 5 


, , M 3 (co 2 - 0 2 Y(co 2 - Oj) (co 2 - \/k) 

1 -k\F 2 (w) = - V 12 V 22 ' 


(« 2 - ^ cl )> 2 - ^ 2 ) 


and from Property 5 


dF(co) _ M 4 (co 2 - £2 2 ) (co 2 - O 2 ) (co 2 - ^ 2 ) (co 2 - Q 


dw (« 2 - ^ 001 ) V - ^ 2 ) 

By combining the above results, we can form the important relation 


dF(co) 

dco 


M 5 [l - F 2 (co)][l - k 2 F 2 (co)] 
(1 - &> 2 /k)(l - kco 2 ) 


Alternatively, we can write 


clx 


= V M 5 


dy 


0 ^J(\ -x 2 )(l -k\x 2 ) y/C 1 -y 2 /k)(l - ky 2 ) 


Ml 


(10.62) 


and if y = y/ky ', y' = 


dx 


o/\fk 


= m 6 


dy 


Mn 


Jo x/l 1 “ * 2 )(1 “ k i x2 ) J° \/(l - y 2 )(l - k 2 y 2 ) 

These are elliptic integrals of the first kind, and they can be put in the more convenient form 

dOi f p d9 


r* do 1 r* 

/ / = / 

20 \ — k\ sin 2 0i Jo 


\J 1 — k 2 sin 2 f 


M 7 


by using the transformations 

x — sin 0\ F = sin (/>i y = sinf 


s/k 


— sin0 
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The above two integrals can assume complex values if complex values are allowed for t/q and </;. By 
letting 



dd 

\J 1 — k 2 sin 2 9 


where z = u + jv 


the solution of the differential equation in Eq. (10.62) can be expressed in terms of a pair of simul¬ 
taneous equations as 



sin0 = sn(z, k) 

sin (pi = sn(M 6 z + Mj, k\) 


(10.63) 

(10.64) 


The entities at the right-hand side are elliptic functions. 

Further progress in this analysis can be made by using the properties of elliptic functions as 
detailed in Appendix B. 

As demonstrated in Sec. B.7, Eq. (10.63) is a transformation that maps trajectory ABCD in 
Fig. 10.14 a onto the positive real axis of the co plane, as depicted in Fig. 10.14/?. Since the behavior 




D' 

-X 

00 


Figure 10.14 Mapping properties of Eq. (10.63). 
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of F(co) is known for all real values of co, constants Mg and M 7 can be determined. In turn, the exact 
form of F((o) can be derived. 

If z = u and 0 < u < K (domain 1 in Sec. B.7), Eqs. (10.63) and (10.64) become 

co = Vk sn(n, k ) (10.65) 

F = sn(M^u + M 7 , k\) (10.66) 

where co and F have real periods of 4 K and 4/C/M (, respectively (see Sec. B.6). If o> = 0, then 
u — 0; and if co = ~J~k, then u = K, as illustrated in Fig. 10.15. Now, F will correspond to F(a>) if it 
has zeros at u — 0 and at two other points in the range 0 < u < K (Property 1), and its magnitude is 
unity at u — K (Property 3). Consequently, F must be of the form illustrated in Fig. 10.15. Clearly, 
for u = 0 


F — sn(M 7 , k\) = 0 


or M 7 = 0. Furthermore, five quarter periods of F must be equal to one quarter period of co, that is, 


M 6 


5 Kx 
~K~ 



Figure 10.15 Plots of co and F versus u. 
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and so from Eq. (10.66) 


F = snl 


5K\u 

K 


, h 


Now F has --plane zeros at 


2 Ki 


for i = 0, 1, 2 


and, therefore, F{a>) must have a>-plane zeros (zero-loss frequencies) at 

Q 0j = \fk sn^^—, k'j for i = 0, 1, 2 
according to Eq. (10.65) (see Fig. 10.14). 

If z = u + j K' and 0 < u < K (domain 3 in Sec. B.7), Eqs. (10.63) and (10.64) assume the 

form 


1 


F = sn 


*Jk sn(n, k) 

5 K^u + jK') 


K 


,k\ 


(10.67) 

( 10 . 68 ) 


If co = oo, u = 0 and F must be infinite (Property 2), that is, 

( j5K x K' 


F = sn 


V 


K 


k | = oo 


and from Eq. (B.19) 


j sn(5KiK'/K,k[) 
cn(5KiK'/K,k\) 


where k[ = 




Hence, it is necessary that 


and, therefore, the relation 


f5K x K’ 



5 K’ _ K[ 
~K~ ~ 


(10.69) 


must hold. The quantities K, K' are functions of k, and similarly K \, K[ are functions of k \; in turn, 
k\ is a function of A p and A a by definition. In effect, Eq. (10.69) constitutes an implicit constraint 
among filter specifications. We shall assume here that Eq. (10.69) holds. The implications of this 
assumption will be examined at a later point. 
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With Eq. (10.69) satisfied, Eq. (10.68) becomes 


/5^i 

F = sn( -j^-u + jK v k\ 


and after some manipulation 


F = 


1 


Evidently, F — oo if 


that is, F has poles at 


k\ sn(5K\u/K , k\) 


u = 2Ki/5 for i =0,1,2 


2 Ki 

Z = — -h jK for/= 0,1,2 


(10.70) 


as depicted in Fig. 10.14, and since line CD maps onto line C'D', F corresponds to F(co). That is, 
F(oj) has two poles in the range 1 /y/k < co < oo and one at oo = oo (Property 2). The poles of F(a>) 
(infinite-loss frequencies) can be obtained from Eqs. (10.67) and (10.70) as 


— 


1 


\fk sn(2 Ki /5, k ) 


for i = 0, 1,2 


Therefore, the infinite-loss frequencies are the reciprocals of the zero-loss frequencies, i.e., 

1 

^ooi = LL 
“0i 

and by eliminating in Eq. (10.61), we have 

M[a>(a>~ — ^5j) (ft) 2 — ^ 02 ) 


F(m) = 


(l a> 2 £ 2 01) (l ^^02) 


(10.71) 


The only unknown at this point is constant M\. With z = K + jv and 0 < v < K' (domain 2 
in Sec. B.7), Eqs. (10.63) and (10.64) can be put in the form 


yfk 


dn(u, k’) 


and 


F = sn 


5Ki(K + jv) 
K 


If ft) = 1, then v = K' / 2 and F( 1) = M J, according to Eq. (10.71). Hence, 
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according to Eqs. (10.69) and (B.8) and after some manipulation, we get 


M\ 


I 


1 


dn(K[/2,k[) s/Fi 


10.6.2 A th-Order Approximation (n Odd) 

For an nth-order approximation with n odd, constant Mj in Eq. (10.64) is zero, and n quarter periods 
of F must correspond to one quarter period of co, that is, 


M 6 = 


nK\ 

~K~ 


Therefore, Eq. (10.64) assumes the form 


where the relation 


f l nKlZ t 
F = sn -, k\ 

K 


nK' _ K[ 
~ Yi 


must hold. The expression for F{a>) can be shown to be 

(-1 ) r oo co 2 - £1? 


F(fi>) = 




nf 


co 2 Q 2 


(10.72) 


where 


n — 1 


and 


r (2 Ki 
= V k sn( ——, k 


for i = 1,2, 


10.6.3 Zeros and Poles of L(—s 2 ) 

The next task is to determine the zeros and poles of L(—s 2 ). From Eqns. (10.59) and (10.72), the 
Z-domain representation of the loss function can be expressed as 


L{z) = 1 + s sn 


2 „„2 / nK \Z 


K 


k\ 


and by factorizing 
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If z i is a root of the first factor, —z\ must be a root of the second factor since the elliptic sine is an 
odd function of z. Consequently, the zeros of L(z) can be determined by solving the equation 



4 N 


l 

e 


In practice, the value of k\ is very small. For example, k\ < 0.0161 if A p < 1 dB and 
A a > 30 dB and decreases further if A p is reduced or A„ is increased. We can thus assume that 
k\ = 0, in which case 



. nK\z 

= sin- 

K 


l 

E 


where K\ — tt/ 2, according to Eq. (B.2). Alternatively, 


.nitz . , _ 

— /-= sinh 

J 2 K 


1 

s 


and on using the identity 


sinh 1 x = ln(x + \J x 2 + 1) 
and Eq. (10.60), we obtain one zero of L(z) as 


Zo = jv 0 


where 


vo 


K 10 0.05A, + | 

mx 10 005A r — 1 


Now sn (nK\z/K, k { ) has a real period of 4 K/n, and as a result all z,- given by 


4 Ki 

Zi = zo H- 

n 


for i = 0, 1,2,... 


must also be zeros of L(z). 

The zeros of L(a> 2 ) can be deduced by using the transformation between the z and o> planes, 
namely, Eq. (10.63). In turn, the zeros of L(— s 2 ) can be obtained by letting a> = s/j. For i = 0, 
there is a real zero of L(—s 2 ) at .y = oq, where 

cr 0 = jVk sn(jv 0 , k) (10.73) 

and for i = 1,2— 1 there are n — 1 distinct complex zeros at .v = a, + ju>i, where 

r ( AKi 

(Ji + jcoi — /V k sn jv o H-, k 


n 


(10.74) 
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The remaining n zeros are negatives of zeros already determined. 
For n = 5, the required values of the elliptic sine are 


. . 4 K\ 

sn( j v 0 + — I 

, 8/sT\ 

sn( jv 0 + — J = sn( jv 0 + 2K 
12 K 


sn jvo + 


5 

16 K 


sn jv 0 ■ 


2 K\ ( 2 K\ 

-)=- sn^jvo--) 

, 2K\ f 2K\ 

= sn( jv o + 2K + — J = —snl jv 0 + — J 

- f) 


^Ji’o + 4K- 4 ^ 


Hence, Eq. (10.74) can be put in the form 


7/ + jcoi = jVk(—iy sn^yu 0 ± , k^j 


for i = 1,2 


Similarly, for any odd value of n 


2 Ki 


i + jcoi = jVk(- 1)' sn j v 0 ±-, k ] for i = 1, 2,..., 


71—1 


Now with the aid of the addition formula (see Sec. B.5) we can show that 


where 


< 7 / + j(Oi 


(-1 yapY^ JQjW 

1 + 


for i = 1,2,.. 


n — 1 


2 



(10.75) 

(10.76) 

(10.77) 


A complete description of L{—s 2 ) is available at this point. It has zeros at s — ±ao, ±(o/+ ja>i) 
and double poles at s = ±//Q,, which can be evaluated by using the series representation of elliptic 
functions given in Sec. B.8. From Eq. (10.73) and (B.30), we have 


~2q' /A Em=o ( - 1 )'V" <m+l} sinh[(2m + 1)A] 
1 + 2^“ =1 (—l)'"^'" 2 cosh277iA 


(10.78) 
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where 

1 io 005a p + i 

A = — In —- 

2n 10 ao5 A> - 1 

The parameter q, which is known as the modular constant, is given by 

q = e~* K 'i K 

Similarly, from Eqs. (10.77) and (B.30) 


V /4 E“=o(- 1 )'V' (m+1) sin (2m t 1)7r ' 

l + 2E“=i(-D'^"' 2 cos^f ” 


(10.79) 


(10.80) 


for i = 1,2,..., (n — l)/2. The modular constant q can be determined by evaluating K and K' 
numerically. A quicker method, however, is to use the following procedure. 

Since dn(0, k) = 1, Eq. (B.32) gives 


s/k' = 


1 — 2q + 2 q 4 — 2 q 9 + ■ ■ ■ 
1 + 2 q + 2q 4 + 2 q^ + ■ ■ • 


(10.81) 


Now, q < 1 since K. K' > 0, and hence a first approximation for q is 

1 ( 1 - VF\ 

qo ~ 2 (i + VfJ 

By eliminating \[k' using Eq. (10.81), rationalizing, and then performing long division we have 


q ^ qo + 2q 5 — 5q 9 + 10 g 13 


Thus, if < 7 „,„ i is an approximation for q 

dm ^ qo + 2<? 3 _1 — 5 dm -1 + l®dm -1 

is a better approximation. By using this recursive relation repeatedly we can show that 

q Ri <70 + 2ql + 15^ + 150^ 3 

Since k is known, the quantities k', q (] , q , <t () . Q,, a,, and co, can be evaluated. Subsequently, the 
normalized transfer function Hn(s) can be formed. 


10.6.4 A th-Order Approximation (n Even) 

So far we have been concerned with odd-order approximations. However, the results can be easily 
extended to the case of even n. 

Function F is of the form 


(nK i 

F = sn -z + K\, k\ 
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where the relation 


nK' _ K[ 

~K~ ~ Yi 

must again hold. The expression for F(o>) in this case is given by 

c-iy A CO 2 - £2? 


where 


F(a>) = 


11 ■ 


r = — and £2,- = \[k sn 
2 


yfk\ ; 


(2i - l)K 


co- 


2 £ 2 ? 


for / = 1,2 ,,r 


The zeros of L(—s 2 ) are 


Si = ±(<7; + j(0i) 


where 


<7/ + j(Oj 


±l<ToVi + j(-iyniW] 
1 + ct 0 2 £ 2 2 


The parameters W, V,-, and <jq are given by Eqs. (10.75), (10.76), and (10.78), as in the case of odd 
72 , and the values of £ 2 ,- can be computed by replacing i by i — i in the right-hand side of Eq. (10.80). 


10.6.5 Specification Constraint 

The results of the preceding sections are based on the assumption that the relation 


nK' 

K 


K[ 

Ki 


(10.82) 


holds. As pointed out earlier, this equation constitutes a constraint among filter specifications of the 
form 


fi(n, k) = f 2 (A p ,A a ) 

Consequently, if three of the four parameters are specified, the fourth is automatically fixed. It is thus 
of interest to put Eq. (10.82) in a more useful form that can be used to evaluate the corresponding 
fourth parameter. 

From the definition of the elliptic sine sn (K k\) = 1 and from Eq. (B.30) 


/ l + q 2 + q* + --- \ 

V 1 + 2<?i + 2 + ■ ■ ■) 


-nK'JKi 


k\ = 4 ^/ql 


2 


where q\ — e 
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In practice, k\ is close to zero, k\ is close to unity, K[ / K \ is large, and, as a result, q\ « 1 ■ Hence, 
we can assume that 


k\ ~ 4 yfql or k\ = \6q\ = 16<? 

By eliminating K[/K i, using Eq. (10.82), we have 

k\ = 16 e~* nK 'l K 


and from Eq. (10.79) 


k\ = 16 q n 


Therefore, from Eq. (10.58) the desired formula is 


10°- 1A f - 1 
10 (UA » - 1 


\6q n 


(10.83) 


If n , k, and A p are specified, the resulting minimum stopband loss is given by 

/ 10 °— 1 \ 

Afl = 10lQg ( 16 qn +1 ) (10 - 84) 

The minimum stopband loss A a is plotted versus k in Fig. 10.16a for various values of A p in 
the range 0.125 <A P < 5 dB. On the other hand, Fig. 10.16ft shows A a versus k for various values 
of n in the range 2 < n < 10. We note in Fig. 10. 16a and ft that for a fixed maximum passband loss 
or a fixed filter order, the minimum stopband loss is reduced if we attempt to increase the selectivity, 
i.e., make the transition characteristic between the passband and stopband steeper. 

Alternatively, if k, A a , and A p are specified, the required approximation order must satisfy the 
inequality 


log 16£> 
n > —-- 

“ log(l/<?) 


where D = 


10 01A “ - 1 
10 01 ^ - 1 


10.6.6 Normalized Transfer Function 

The results obtained through the previous mathematical roller coaster can now be summarized in 
layman’s language for the DSP practitioner. 

An elliptic normalized lowpass filter with a selectivity factor k, a maximum passband loss of 
A p dB, and a minimum stopband loss equal to or in excess of A a dB has a transfer function of the 
form 


H n (s) = 


Hq r .V 2 + ClQi 

D 0 (s) j 2 + bus + b 0i 


(10.85) 
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Figure 10.16 

4, 6, 8, 10. 


Plots of A a versus k: (a) n = 5, A p = 0.125, 0.25, 0.5, 1.0, 2.0 dB, ( b ) A p = 0.5 dB, n = 2, 
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where 


and 



for odd n 
for even n 


D 0 (s) = 


S + CTO 

1 


for odd n 
for even n 


The transfer-function coefficients and multiplier constant Hq can be computed by using the 
following formulas in sequence: 


where 


k! = yj\ -k 2 

1 ( 1 - VF\ 

qo 2^1 + vfJ 

q = q 0 + 2ql + 1 5q% + 150^ 3 
_ 10 01A * - 1 
° ~ 10 01A * - 1 

log 16D 

n > - 

“ log(l/?) 

1 io 005A p + l 

A = — In —- 

2 n 10 0 05A p - 1 

2q 1 ' 4 E“=o sinh[(2m + 1)AJ 
1 + 2^“ =1 (— l) m q mI cosh 2m A 

W = \j( l+K)(l + f) 

2 q l/A E“ =0 (- 1 )'"? m(m+1) sin 
Q ‘ = l + 2E”=i(-l) m r 2 cos^ “ 


( 10 . 86 ) 

(10.87) 

( 10 . 88 ) 

(10.89) 

(10.90) 

(10.91) 

(10.92) 

(10.93) 

(10.94) 


J i for odd n 

[ i — | for even n 



boi = 


(aoVi ) 2 + (QiW ) 2 

(1 + 


i = 1,2, ..., r 


(10.95) 

(10.96) 

(10.97) 
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h. . — 

2 ooVi 


(10.98) 

l+afor 


Ho= | 

( rr' boi 
i aoi 

[ 10 - 005 Ap n ; =1 

boi 

1 flQi 

for odd n 

(10.99) 

for even n 


The actual minimum stopband loss is given by Eq. (10.84). The series in Eqs. (10.92) and 
(10.94) converge rapidly, and three or four terms are sufficient for most purposes. 


Example 10.6 


An elliptic filter is required satisfying the following specifications: 


• Passband edge w p : V03 rad/s 

• Stopband edge co a : 1 /V(h9 rad/s 

• Maximum passband loss A p : 0.1 dB 

• Minimum stopband loss A a : 50.0 dB 


Form Hn(s). 


■ Solution 

From Eqs. (10.86)-( 10.90) 

k = 0.9 A:'= 0.435890 q 0 = 0.102330 

q = 0.102352 D — 4,293,090 n > 7.92 or n = 8 

From Eqs. (10.91)—(10.99) the transfer-function coefficients in Table 10.1 can be ob¬ 
tained. The corresponding loss characteristic is plotted in Fig. 10.17. The actual value 
of A a is 50.82 dB according to Eq. (10.84). ■ 

Table 10.1 Coefficients of //,v(.v) (Example 10.6) 


i «o, bu 


1 1.434825£ + 1 2.914919E - 1 8.711574E-1 

2 2.231643 6.123726E- 1 4.729136E - 1 

3 1.320447 8.397386E- 1 1.825141E-1 

4 1.128832 9.264592E- 1 4.471442E - 2 

H 0 = 2.876332E - 3 
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Figure 10.17 Loss characteristic of an eighth-order, elliptic filter (Example 10.6). 


10.7 BESSEL-THOMSON APPROXIMATION 

Ideally, the group delay of a filter should be independent of frequency, or, equivalently, the phase 
shift should be a linear function of frequency to minimize delay distortion (see Sec. 5.7). Since the 
only objective in the preceding three approximations is to achieve a specific loss characteristic, there 
is no reason for the phase characteristic to turn out to be linear. In fact, it turns out to be nonlinear as 
one might expect. Consequently, the delay tends to vary with frequency, in particular in the elliptic 
approximation. 

Consider the transfer function 


H(s) = 


bo 


bo 


E"=o b i s ‘ s n B(l/s) 


( 10 . 100 ) 


where 


b, = 


( 2 n - i)\ 


2" l i\(n — i)\ 


( 10 . 101 ) 


Function B{s) is a Bessel polynomial, and s" B( 1 /s) can be shown to have zeros in the left-half s 
plane. B(l/ja>) can be expressed in terms of Bessel functions [2, 10] as 


1 


1 


B 


— [(-1 ) n J-Aco)- jJ v (co)]e J< ° 
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where v = n + j and 


Mco) = u l ’J2 7 


(-1 )‘co 


i, . 2 / 


i=0 


2 2i+v i\F(v + i + 1) 


( 10 . 102 ) 


(r(-) is the gamma function). Hence, from Eq. (10.100) 


\mjco)\ 2 = 


2bl 


7IC0 2n+l [Jl v (co) + J 2 (co)\ 

-1 (-!)"-/„(«) 


Q(co) = —u> + tan 


d6{w) 

t(co) = -= 1 — 

dco 


J~v(( 0 ) 

(-i r(j- v j' v -j v r_ v ) 


+ r-{co) 


Alternatively, from the properties of Bessel functions and Eq. (10.102) [2] 


\H(jCD)\ 2 = 1 
r(ftj) = 1 


or 2 (n — 1) cl) 4 

2n - 1 + (2n - 1) 2 (2« - 3) + ” ’ 

, , 2 n 

b o 


(10.103) 

(10.104) 


Clearly, as co —»■ 0, // (./ft;) -> 1 and r(w) —>■ 1. Furthermore, the first n — 1 derivatives of t(co) 
with respect to a> 2 are zero if o> = 0, which makes the approximation maximally flat at the origin. 
This means that there is some frequency range 0 < co < ca p for which the delay is approximately 
constant. On the other hand, if co -* oo, | H ( jco)\ —> 1 /( jco) n —» 0 and, therefore, H (,v) is a lowpass 
constant-delay approximation. This is sometimes referred to as the Bessel approximation since it 
uses a Bessel function. However, the possibility of using the function in Eq. (10.100) as a normalized 
lowpass approximation with a maximally flat group delay at he origin was proposed by Thomson 
[6] and its correct name should, therefore, be the Bessel-Thomson approximation. 

Note that the formulas in Eqs. (10.103) and (10.104) are used here to demonstrate the maximally 
flat property of the group delay and have no other practical usefulness. For any other purpose, the 
amplitude and phase responses or the loss and delay characteristics should be obtained by using the 
transfer function in Eq. (10.100). 

The Bessel-Thomson approximation has a normalized group delay of 1 s. However, any 
other delay can be achieved by replacing s by tqs in Eq. (10.100). Typical loss and group-delay 
characteristics for the Bessel-Thomson approximation are plotted in Fig. 10.18 and 10.19, respec¬ 
tively. 
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Figure 10.18 Loss characteristics of normalized Bessel-Thomson lowpass filters: n = 3, 6, 9. 



Figure 10.19 


Delay characteristics of normalized Bessel-Thomson lowpass filters: n = 3,6, 9. 
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Form the Bessel-Thomson transfer function for n = 6. 


■ Solution 


From Eqs. (10.100) and (10.101), we obtain 


H(s) = 


10, 395 


10, 395 + 10, 395s + 4725s 2 + 1260s 3 + 210s 4 + 21s 5 + s 6 " 


(See Fig. 10.18 and 10.19 for the loss and delay characteristics). 


10.8 TRANSFORMATIONS 


In the preceding sections, only normalized lowpass approximations have been considered. The rea¬ 
son is that denormalized lowpass, highpass, bandpass, and bandstop approximations can be easily 
derived by using transformations of the form 

s = /(s) 

10.8.1 Lowpass-to-Lowpass Transformation 

Consider a normalized lowpass transfer function H N (s) with passband and stopband edges co p and 


u > a , and let 


(10.105) 


s = Xs 


in Hn(s). If .v = jco, we have s — jco/X and hence Eq. (10.105) maps the j axis of the s plane onto 
the j axis of the s plane. In particular, ranges 0 to ja> p and jco a to joo map onto ranges 0 to jco p /X 
and jco a /X to joo, respectively, as depicted in Fig. 10.20. Therefore, 


Hlp(s) = H n (s ) 


s—Xs 


constitutes a denormalized lowpass approximation with passband and stopband edges a> p /X and 
(i>a/X, respectively. A graphical illustration of the lowpass-to-lowpass transformation is shown in 
Fig. 10.21. 

10.8.2 Lowpass-to-Bandpass Transformation 

Now let 



in Hn(s), where B and coq are constants. If v = jco and s = jco, we have 



or 
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j°> 


s plane 


jo>p 



-jlOp — 


— ~jo>a 


> 

s plane 


JMa 

t 

t 1 -< 

1 


j<Op _ 


X 

j“>a 


X 


Figure 10.20 Lowpass-to-lowpass transformation: Mapping. 



Figure 10.21 Lowpass-to-lowpass transformation: Graphical interpretation. 
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JV 


s plane 


-JVa 


J“>p 


-JlOp- 


-JMa 




JVc2 


s plane 


-J0)p2 


-ja>p\ 


J«>a 1 


-JO>a 1 - 


-joipl 


~]0>p2 


-]Ma2 - 


Figure 10.22 

Lowpass-to-bandpass transformation: Mapping. 

Table 10.2 

Analog-filter transformations 

Type 

Transformation 

LP to LP 

s = Xs 

LP to HP 

X 

s = - 
s 

LP to BP 

--sM) 

LP to BS 

Bs 

S 2 + COq 

Hence 

r «o 

0> = < ±<Wpl> ±0)p2 
[ ±&) fl l, ±0) a 2 


where 


^ , 2 
u>p \! 0)p2 — T - h y ®0 ' 


if a) = 0 
if ft) = iftlyj 
if ft) = 


02 pB 


^ | / 2 i 

&>al, &>a2 — -F - ^-F \ ®0 + 




2 
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The mapping for s = jco is thus of the form illustrated in Fig. 10.22, and consequently 


H B p(s) = //,v(-v) ! 





is a bandpass approximation with passband edges co p i, co P 2 and stopband edges co a i, u > a 2 • A graphical 
illustration of the lowpass-to-bandpass transformation is shown in Fig. 10.23. 

Similarly, the transformations in the second and fourth rows of Table 10.2 yield highpass and 
bandstop approximations. 
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PROBLEMS 

10.1. A stable analog system is characterized by the transfer function in Eq. (10.5). Show that the steady-state 
sinusoidal response of the system is given by Eq. (10.11). 

10.2. A fourth-order lowpass Butterworth filter 5 is required. 

(a) Obtain the normalized transfer function Hn(s). 

(b) Derive expressions for the loss and phase shift. 

(c) Calculate the loss and phase shift at a> = 0.5 rad/s. 

( d) Obtain a corresponding denormalized transfer function H D (s) with a 3-dB cutoff frequency at 
1000 rad/s. 

10.3. A fifth-order Butterworth filter is required. 

(a) Form H(s). 

(b) Plot the loss characteristic. 

10.4. Filter specifications are often described pictorially as in Fig. P 10.4, where o> p and u> a are desired passband 
and stopband edges, respectively, A p is the maximum passband loss, and A a is the minimum stopband 
loss. Find n and, in turn, form H(s), if a> p = 1, u> a = 3 rad/s, A p = 3.0, A a > 45 dB. Use the 
Butterworth approximation. 

10.5. In an application a normalized Butterworth lowpass filter is required that would satisfy the following 
specification: 

• Passband edge a> p : 0.6 rad/s 

• Stopband edge a> a \ 2.5 rad/s 

• Maximum passband loss A p : 1.0 dB 

• Minimum stopband loss A a : 40.0 dB 

(a) Find the minimum filter order that would satisfy the specifications. 

(b) Calculate the actual maximum passband loss and minimum stopband loss. 

(c) Obtain the required transfer function. 

10.6. A third-order lowpass filter with passband edge w p = 1 rad/s and passband ripple A p = 1.0 dB 
is required. Obtain the poles and multiplier constant of the transfer function assuming a Chebyshev 
approximation. 


^The filters considered in this problem section are all analog filters. 



APPROXIMATIONS FOR ANALOG FILTERS 521 



Figure P10.4 


10.7. A fifth-order normalized lowpass Chebyshev filter is required. 

(a) Form H(s) if A p = 0.1 dB. 

( b ) Plot the loss characteristic. 

10.8. A Chebyshev filter that would satisfy the specifications of Fig. P10.8 is required. Find n and, in turn, 
form H(s). 


0.5 


30 


45 


cd, rad/s 


1.0 


3.0 


4.0 


Figure P10.8 
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10.9. An application calls for a normalized Chebyshev lowpass filter that would satisfy the following specifi¬ 
cation: 

• Passband edge a> p : 1.0 rad/s 

• Stopband edge co a : 2.2 rad/s 

• Maximum passband loss A p : 0.2 dB 

• Minimum stopband loss A„: 40.0 dB 

(a) Find the minimum filter order that would satisfy the specifications. 

( b ) Calculate the actual maximum passband loss and minimum stopband loss. 

(c) Obtain the required transfer function. 


10.10. (a) Show that 

T„+ i(w) = 2coT n (<o) - r„-i(a>) 
( b) Hence demonstrate that the following relation [5] holds: 


;i (-l) r 0i - r - 1)! 

T„(w) =~J2 ~ — -—-(2tu) 2 


2 f^ H(n-2r)! 


where K = Int ( — 


(I 


(c) Obtain rio(tu). 


10.11. (a) Find A(a>) for the normalized lowpass Butterworth and Chebyshev approximations if w 1. 
(b) Show that A(oo ) increases at the rate of 20 n dB/decade in both cases. 


10.12. The inverse-Chebyshev approximation can be derived by considering the loss function 


A(cu) = 10 log 


1 ' 

1 + 


where 


S 2 


1 

10 01A <- - 1 


(a) Show that A(m) represents a highpass filter with an equiripple stopband loss, a monotonic increasing 
passband loss, and a stopband edge co a = 1 rad/s. 

( b ) Show that the filter represented by A(m) has a transfer function of the form 


Hhp(s) = 


HU* ~ Zi) 

rr=i ( a - 


where Zi and p, for i — 1, 2,..., n are given by Eqs. (10.50), (10.51), and (10.53), respectively. 

(c) Show that H N (s ) = H hp (1/s) is the normalized lowpass transfer function for the inverse- 
Chebyshev approximation. 


10.13. A fourth-order inverse-Chebyshev filter with a minimum stopband loss of 40 dB is required. 

(a) Obtain the required transfer function. 

(b) Find the 3-dB cutoff frequency. 
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10.14. An application requires a normalized inverse-Chebyshev lowpass filter that would satisfy the following 
specifications: 


• Passband edge co p : 0.5 rad/s 

• Stopband edge : 1.0 rad/s 

• Maximum passband loss A p : 0.5 dB 

• Minimum stopband loss A a : 30.0 dB 

(a) Find the minimum filter order that would satisfy the specifications. 

(b) Obtain the required transfer function. 

(c) Calculate the actual maximum passband loss and minimum stopband loss. 


10.15. (a) Write a MATLAB m-file that can be used to obtain the normalized elliptic transfer function for 

an arbitrary set of given specifications {k, A p , A a j where k is the selectivity, A p is maximum 
passband loss, and A a is the minimum stopband loss. Your program should also compute the actual 
stopband loss. 

(. b ) Use the program in part (a ) to obtain elliptic transfer functions for two different sets of specifications 
that would result in an even- and an odd-order transfer function of order greater than 3. 

(c) Plot the loss characteristics associated with the transfer functions obtained. 

10.16. (a) A lowpass elliptic filter is required that would satisfy the specifications 


, 7 =4 A p = 1.0 dB At = 0.7 


Form H(s). 

( b ) Determine the corresponding minimum stopband loss. 

(c) Plot the loss characteristic. 

10.17. In a particular application an elliptic lowpass filter is required. The specifications are 


• Selectivity k: 0.6 

• Maximum passband loss A p : 0.5 dB 

• Minimum stopband loss A a : 40.0 dB 

10.18. An elliptic lowpass filter that would satisfy the specifications 

• Selectivity k: 0.95 

• Maximum passband loss A p : 0.3 dB 

• Minimum stopband loss A a : 60.0 dB 


is required. 


(a) Determine the order of the transfer function. 

( b ) Determine the actual loss. 

(c) Obtain the transfer function. 

10.19. (a) Obtain the normalized transfer function H(s) for the eighth-order Bessel-Thomson approximation. 
( b ) Plot the corresponding phase characteristic. 


10.20. (a) Obtain the normalized transfer function H(s) for the ninth-order Bessel-Thomson approximation. 
(. b ) Using the transfer function in part ( a ), obtain expressions (i) for the loss characteristic, (ii) for the 
phase response, and (iii) for the group delay characteristic. 

(c) Using MATLAB or similar software, plot (i) the loss characteristic, (ii) the phase response, and 
(iii) the delay characteristic for the frequency range 0 to 6 rad/s. 
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10.21. Show that 


where 


H(s) = 


ELo bi{-sy 

ELo b ‘ si 


( 2 n - (')! 
2" _i i !(n — i)\ 


is a constant-delay, allpass transfer function. 

10.22. A constant-delay lowpass filter is required with a group delay of 1 ms. Form H(s) using the sixth-order 
Bessel-Thomson approximation. 

10.23. An normalized inverse-Chebyshev lowpass filter has a transfer function 


Hn(s) — 


H() t-t s~ + floi 

s + boo , s 2 + b u s + boi 
1 = 1 


where 


H 0 = 1.581147£-2 boo = 5.957330£ - 1 

a 01 = 2.894427 b oi = 3.161351£ - 1 b n = 8.586353£ - 1 

ciQ2 = 1.105573 b 02 = 2.686568 E - 1 i> 12 = 2.787138£ - 1 

(a) By using the lowpass-to-lowpass transformation, obtain a lowpass transfer function that would 
result in a stopband edge of 1000 Hz. 

(b) By using MATLAB or similar software, find the passband edge of the transformed filter assuming 
a maximum passband loss of 1.0 dB. 

10.24. A normalized lowpass Chebyshev filter has a transfer function 


Ho tt 1 

H n (s) = -— TT —- 

s + boo -*--*■ s 2 + bus + b 0 , 

1 = 1 


where 


Ho = 0.287898 b 00 = 0.461411 

b 0 i = 1.117408 b n =0.285167 

b 02 = 0.558391 b i2 = 0.746578 

(a) By using the lowpass-to-highpass transformation, obtain a highpass transfer function that would 
result in a passband edge of 10,000 Hz. 

(b) By using MATLAB or similar software, find (i) the maximum passband loss and (ii) the minimum 
stopband loss of the highpass filter assuming a stopband edge of 5800 Hz. 

10.25. A normalized elliptic transfer function for which k = 0.8 and A p =0.1 dB is subjected to the 
lowpass-to-bandpass transformation. Find the passband and stopband edges of the bandpass filter if 
B = 200, a )o = 1000 rad/s. 

10.26. A normalized elliptic transfer function for which k = 0.7 and A p = 0.5 dB is subjected to the 
lowpass-to-bandstop transformation. Find the passband and stopband edges of the bandstop filter if 
B = 100, coq = 2000 rad/s. 
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10 . 27 . A normalized, third-order, elliptic, lowpass filter is characterized by the transfer function 


H n (s) = H 0 


5“ + CIqi 

(s + boo)(s 2 + bus + boi) 


where 


H 0 = 6.710103£ - 2 

b 00 = 3.715896£ - 1 a ol = 2.687292 

b n = 3.044886£ - 1 b ol = 4.852666£ - 1 

(a) Obtain a bandpass elliptic transfer function by applying the lowpass-to-bandpass transformation 
assuming that B 0 — 1.153776 E + 3 and a > 0 = 1.445683£ + 3. 

(. b ) By plotting the loss characteristic of the bandpass filter over the frequency range 0 to 4000 rad/s, 
find the maximum passband loss, the minimum stopband loss, the passband edges, and stopband 
edges of the filter. 

10 . 28 . A normalized, third-order, elliptic, lowpass filter is characterized by the transfer function 

s 2 + floi 

H n (s) = H 0 ----- 

(s + booXs 2 + bus + boi) 


where 


H 0 = 4.994427£ - 2 

boo = 3.461194£ - 1 a 0 i = 3.011577 

£n = 2.961751£ — 1 b oi = 4.345639£ - 1 

(a) Obtain a bandstop elliptic transfer function by applying the lowpass-to-bandpass transforma¬ 
tion assuming that B 0 = 8.0£ + 2 and a> 0 = 7.885545£ + 02. 

( b) By plotting the loss characteristic of the filter over the frequency range 0 to 2000 rad/s, find the 
maximum passband loss, the minimum stopband loss, the passband edges, and stopband edges of 
the bandstop filter. 

10 . 29 . A lowpass filter is required that would satisfy the following specifications: 

• Passband edge Wp: 2000 rad/s 

• Stopband edge <n a : 7000 rad/s 

• Maximum passband loss A p : 0.4 dB 

• Minimum stopband loss A a : 45.0 dB 

(a) Assuming a Butterworth approximation, find the required order n and the value of the transforma¬ 
tion parameter X. 

( b ) Form H(s). 

10 . 30 . Repeat Prob. 10.29 for the case of a Chebyshev approximation and compare the design obtained with 
that obtained in Prob. 10.29. 

10 . 31 . Repeat Prob. 10.29 for the case of an inverse-Chebyshev approximation and compare the design 
obtained with that obtained in Prob. 10.29. 

10 . 32 . Repeat Prob. 10.29 for the case of an elliptic approximation and compare the design obtained with that 
obtained in Prob. 10.29. 

10 . 33 . A highpass filter is required that would satisfy the following specifications: 

• Passband edge a> p : 2000 rad/s 

• Stopband edge <n a : 1000 rad/s 
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• Maximum passband loss A p : 0.5 dB 

• Minimum stopband loss A a : 40.0 dB 

(a) Assuming a Butterworth approximation, find the required order n and the value of the transforma¬ 
tion parameter X. 

(b) Form H(s). 

10.34. Repeat Prob. 10.33 for the case of a Chebyshev approximation and compare the design obtained with 
that obtained in Prob. 10.33. 

10.35. Repeat Prob. 10.33 for the case of an inverse-Chebyshev approximation and compare the design 
obtained with that obtained in Prob. 10.33. 

10.36. Repeat Prob. 10.33 for the case of an elliptic approximation and compare the design obtained with that 
obtained in Prob. 10.33. 

10.37. A bandpass filter is required that would satisfy the specifications depicted in Fig. PI 0.37. Assuming 
that the elliptic approximation is to be employed, find suitable values for a> 0 , k, B, and n. 



Figure P10.37 

10.38. A bandpass filter is required that would satisfy the following specifications: 

• Lower passband edge co pl : 9500 rad/s 

• Upper passband edge a) p2 : 10,500 rad/s 

• Lower stopband edge a> a i: 5000 rad/s 

• Lower stopband edge w a 2 : 15,000 rad/s 

• Maximum passband loss A p : 1.0 dB 

• Minimum stopband loss A a : 50.0 dB 

(a) Assuming a Butterworth approximation, find the required order n and the value of the transforma¬ 
tion parameters B and co 0 . 

(b) Form H(s). 
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10.39. Repeat Prob. 10.38 for the case of a Chebyshev approximation and compare the design obtained with 
that obtained in Prob. 10.38. 

10.40. Repeat Prob. 10.38 for the case of an inverse-Chebyshev approximation and compare the design 
obtained with that obtained in Prob. 10.38. 

10.41. Repeat Prob. 10.38 for the case of an elliptic approximation and compare the design obtained with that 
obtained in Prob. 10.38. 

10.42. A bandstop filter is required that would satisfy the specifications depicted in Fig. P10.42. Assuming 
that the elliptic approximation is to be employed, find suitable values for wq, k, B, and n. 



Figure P10.42 

10.43. A bandstop filter is required that would satisfy the following specifications: 

• Lower passband edge ai p i: 20 rad/s 

• Upper passband edge a> P 2 '- 80 rad/s 

• Lower stopband edge co aI : 48 rad/s 

• Lower stopband edge co a 2 : 52 rad/s 

• Maximum passband loss A p : 1.0 dB 

• Minimum stopband loss A a : 25.0 dB 

(a) Assuming a Butterworth approximation, find the required order n and the value of the transforma¬ 
tion parameters B and o>o- 

( b ) Form H(s). 

10.44. Repeat Prob. 10.43 for the case of a Chebyshev approximation and compare the design obtained with 
that obtained in Prob. 10.43. 

10.45. Repeat Prob. 10.43 for the case of an inverse-Chebyshev approximation and compare the design 
obtained with that obtained in Prob. 10.43. 
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10.46. Repeat Prob. 10.43 for the case of an elliptic approximation and compare the design obtained with that 
obtained in Prob. 10.43. 


R 

O-MA 




l 2 

■'75555' v 


c 1 


R 


O 


Figure P10.47 

10.47. Figure PI0.47 shows an LC filter. 

(a) Derive a highpass LC filter. 

(b) Derive a bandpass LC filter. 

(c) Derive a bandstop LC filter. 













CHAPTER 

11 


DESIGN OF 
RECURSIVE 
(HR) FILTERS 


11.1 INTRODUCTION 

Approximation methods for the design of recursive (HR) filters differ quite significantly from those 
used for the design of nonrecursive filters. The basic reason is that in the first case the transfer 
function is a ratio of polynomials of z whereas in the second case it is a polynomial of 1 . 

In recursive filters, the approximation problem is usually solved through indirect methods. 
First, a continuous-time transfer function that satisfies certain specifications is obtained using one of 
the standard analog-filter approximations described in Chap. 10. Then a corresponding discrete-time 
transfer function is obtained using one of the following methods [1-9]: 

1. Invariant impulse-response method 

2. Modified version of method 1 

3. Matched-’ transformation 

4. Bilinear transformation 

This chapter is concerned with the indirect approach to the design of recursive filters. It starts 
with the realizability constraints that must be satisfied by the discrete-time transfer function and then 
deals with the details of the aforementioned approximation methods. The chapter also describes a 
set of "-domain transformations that can be used to derive transformed lowpass, highpass, bandpass, 
or bandstop discrete-time transfer functions from a given lowpass discrete-time transfer function. It 
concludes with a general discussion on the choice between recursive and nonrecursive designs. 
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Iterative methods that are suitable for the design of nonrecursive and recursive filters are 
considered in Chaps. 15 and 16, respectively. 

11.2 REALIZABILITY CONSTRAINTS 

In order to be realizable by a recursive filter, a transfer function must satisfy the following constraints: 

1. It must be a rational function of z with real coefficients. 

2. Its poles must lie within the unit circle of the z plane. 

3. The degree of the numerator polynomial must be equal to or less than that of the denominator 
polynomial. 

The first constraint is actually artificial and is imposed by our assumption in Chaps. 1 and 4 
that signals are real and that the constituent elements of a digital filter perform real arithmetic. If 
unit delays, adders, and multipliers are defined for complex signals in terms of complex arithmetic, 
then transfer functions with complex coefficients can be considered to be realizable [10, 11]. The 
second and third constraints will assure a stable and causal filter, respectively (see Secs. 5.3 and 5.2, 
respectively). 


11.3 INVARIANT IMPULSE-RESPONSE METHOD 

Consider the impulse modulated filter F A of Fig. 11.1, where S is an ideal impulse modulator and 
Fa is an analog filter characterized by H A (s). Fa can be represented by a continuous-time transfer 
function H A (s ) or, equivalently, by a discrete-time transfer function H D (z), as shown in Sec. 6.9. 
From Eq. (6.53b) 

h (Q | ) | 

HaU<o) = H D (e jmT ) = + - X] H A <J(o + jkco s ) (11.1) 

~ k——oo 

where u> s = 2n/T is the sampling frequency and 

h A (t) = C~ l H A {s) 

h A (0+)= \im[sH A {s)] (11.2) 

s—>oo 

H d (z) = Zh A {nT) 



Figure 11.1 Impulse modulated filter. 
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Therefore, given an analog filter F A , a corresponding digital filter, represented by H D (z), can be 
derived by using the following procedure: 

1. Deduce h A {t), the impulse response of the analog filter. 

2. Replace t by nT in h A {t). 

3. Form the z transform of h A (nT). 


If 


then 


If, in addition. 


HaUco) * 0 


for \co\ > 


co s 

y 


oo 

71 H A (jw + jkw s ) ss 0 for \co\ < y 

k=—oo 

0 


M0+) = 0 


(11.3a) 


(11.3b) 


(11.4) 


Eqs. (11.1), (11.3b), and (11.4) yield 

H A (jco) = H D (e ja>T ) « ^H A (jco) for |«| < y (11.5) 

i.e., if H,\(j<>>) is bandlimited, the baseband frequency response of the derived digital filter is ap¬ 
proximately the same as that of the analog filter except that the gain of the digital filter is multiplied 
by the constant l/T. This constant can be eliminated by multiplying the numerator coefficients of 
H d (z) by T. 

If the denominator degree in H A (s) exceeds the numerator degree by at least 2, the basic 
assumptions in Eqs. (11.3a) and (11.4) hold for some sufficiently high value of a> s . If, in addition, 
the poles of H A (s ) are simple, we can write 

N R 

Ha(s) = V -— (11.6) 

tr * - P' 

Hence from steps 1 and 2 above 

N N 

h A (t) = jC,- 1 H A (s) = J2 R i eP,t and h A (nT) = J2 R i e PinT 

i =1 i=l 

(see Sec. 10.2.4). Subsequently, from step 3 

N R 

H D {z) = Zh A (nT) = Y J T^ Z T Pi (H-7) 

. Z, C 1 
1 =1 

Since complex-conjugate pairs of poles in Ha(s) yield complex-conjugate values of Ri and 
e Tpi , the coefficients in Ho(z ) are real. Pole pi — Oj + ja>j gives rise to a pole pi in Hq(z), where 

Pi = e Tpi = e 


Jioi+jaii) 
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and for er,- < 0, \p;\ < 1. Hence a stable analog filter yields a stable digital filter. Also the numerator 
degree in Hq(z) cannot exceed the denominator degree as can be easily verified, and Il/)(z) is 
therefore realizable. 

The method described, which is known as the invariant impulse-respotise method, yields good 
results for Butterworth, Bessel-Thomson, or Chebyshev lowpass and bandpass filters for which the 
basic assumptions of Eqs. (11.3a) and (11.4) hold. An advantage of the method is that it preserves 
the phase response as well as the loss characteristic of the analog filter. 


Example 11.1 


Design a digital filter by applying the invariant impulse-response method to 
the Bessel-Thomson transfer function 


H a (s) = 


105 


105 + 105 s + 45s 1 2 + 10s 3 + s 4 


(see Sec. 10.7). Employ a sampling frequency a> s = 8 rad/s; repeat with co s = 16 rad/s. 

■ Solution 


The poles of H A (s) and the residues in Eq. (11.6) are 

p ], p\ = -2.896211 ± y'0.8672341 
p 2 ,p * 2 = —2.103789 ± _/2.657418 
R u R* = 1.663392 =f j 8.396299 
R 2 , R*2 = -1.663392 ± ;'2.244076 


Hence from Eq. (11.7) 


2 

TH d (z) = J2 

7—1 


aijz + a 2 jz 2 
b 0j + b\jZ + z 2 


where coefficients a,- 7 and bjj are given in Table 11.1. The transfer function is multiplied 
by T to eliminate the effect of constant 1/7 in Eq. (11.5). 


Table 11.1 Coefficients of TH D (z) (Example 11.1) 


j «ly «2/ b 0 j bij 


1 6.4523337 — 1 2.612851 1.0573997-2 -1.5977007-1 

8 

2 -8.3452337- 1 -2.612851 3.6713017-2 1.8919077-1 


1 3.1145507- 1 1.306425 1.0282997-1 -6.0450807-1 

16 

2 -3.7900117- 1 -1.306425 1.9160647- 1 -4.4047947-1 
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The loss and delay characteristics obtained are plotted in Fig. 11.2a and b, respec¬ 
tively. The higher sampling frequency gives better results because aliasing errors are less 
pronounced. 



(a) 



Figure 11.2 Example 11.1: (a) Loss characteristics, ( b ) delay characteristics. 
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11.4 MODIFIED INVARIANT IMPULSE-RESPONSE METHOD 


Aliasing errors tend to restrict the application of the invariant impulse-response method to the 
design of allpole filters. 1 However, a modified version of the method is available, as will now be 
demonstrated, which can be applied to filters that also have zeros in the finite 5 plane. 

Consider the transfer function 

H 0 N(s) HoUZtis-Zi) 


H a (s) = - 

D & nh(s-Pi) 

where M can be as high as N. We can write 

H 0 H A1 (s) 


H a (s) = 


where 


/A 1 (.v) = 

H a2 (s) = 

Clearly, with M, N >2 Eq. (11.2) yields 

^ai(0+) = 0 


H a2 (s) 

1 

DW 

1 


N(s) 

/ J A2(0+) = 0 


( 11 . 8 ) 


(11-9) 

( 11 . 10 ) 


and furthermore 


H A djo>)* 0 ] 

H A2 (jco) * 0 I 


for \w\ > 


for some sufficiently high value of w s . Consequently, from Eq. (11.1) we can write 


H M {jcS) = H m (e’ mT ) « ^H A1 (jco) 


H A2 (jot) = H D2 {e^ T ) « —H A2 (ja>) 


co s 

for M < — 
2 


Therefore, we can form 


H d (z) = 


H 0 H m (z) 

Hd 2 (z) 


such that 




H D2 (e> l '> T ) 

If the zeros and poles of H A (s) are simple, Eq. (11.7) gives 


Cl). 

for \(o\ < — 
2 


H m (z) = 

i= 1 
M 

H d2 (z ) = ^ 


AjZ 

z — e Tp ‘ 
B iZ 


i 1 


z — e 


TZi 


(11.11) 


Nfiz) 

Dx{z) 

(11.12) 

N 2 (z) 

D 2 (z) 

(11.13) 


1 These are filters that have only poles in the finite s plane. 
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Thus from Eqs. (11.11)-(11.13) 


H d (z) = 


H 0 N 1 (z)D 2 (z) 
N 2 (z)D 1 (z) 


(11.14) 


The derived filter can be unstable since some of the zeros of N 2 (z) may be located on or outside 
the unit circle of the z plane, but the problem can be easily overcome. For an arbitrary pole of Hd(z), 
say, pi , we can write 


\(e J * T - Pi )I = 


-e jcoT Pi e~ jwT - 


= I Pi 


= I Pi 


,jo>T 


? jo>T 


Pi 

1 


If pi is real, we have 


\(e Ja,T - pi)\ = \p, \ 




and if pi and p* are a complex-conjugate pair of poles, then 


\(e ja>T - P i){e imT - p*)\ = \ Pi \ 2 






Hence any poles of Hq{z) located outside the unit circle can be replaced by their reciprocals without 
changing the shape of the loss characteristic. This will introduce a constant vertical shift in the loss 
characteristic but the problem can be easily eliminated by adjusting Hq, the multiplier constant of 
the transfer function. 

The method yields excellent results for elliptic filters. For this class of filters, polynomial N 2 (z.) 
turns out to be a mirror-image polynomial with roots on the negative real axis (see Sec. 9.2.3) and, in 
effect, its roots occur in reciprocal pairs. This means that half of the roots of N 2 (z) would be located 
outside the unit circle of the z plane and since these roots are poles in the derived transfer function 
given by Eq. (11.14), the filter obtained would be unstable. However, the problem can be easily 
eliminated by applying the above stabilization technique. If N 2 (z) has K roots p, that are located 
outside the unit circle, a stable filter can be obtained by replacing each pt by 1 / p, and then dividing 
the multiplier constant Hq in Eq. (1 1.14) by nf \Pi\. 

The main problem with the modified invariant impulse-response method has to do with the 
order of the filter obtained. Unfortunately, polynomials N\(z) and N 2 (z) tend to increase the order 
of H D (z), as can be seen in Eq. (11.14), and that makes the method uneconomical. The method is 
described in some detail here only because it provides a theoretical foundation for the matched-z 
transformation method as will be demonstrated in Sec. 11.5. 
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Example 11.2 


The transfer function 


3 

Ha{s)= HqY[ 
j =1 


aoj + s 2 
boj + b\js + s 2 


where Hq, ao j, and b\j are given in Table 11.2, represents a lowpass elliptic filter satisfying 
the following specifications: 


• Passband ripple: 0.1 dB 

• Minimum stopband loss: 43.46 dB 

• Passband edge: V0.8 rad/s 

• Stopband edge: l/\/0.8 rad/s 


Employing the modified invariant impulse-response method, design a corresponding digital 
filter. Use co s = 7.5 rad/s. 


Table 11.2 Coefficients of H A {s) (Example 11.2) 


j 

a 0j 

hj 

bij 


1 

1.199341 Zi + 1 

3.581929E - 1 

9.508335 E - 

1 

2 

2.000130 

6.860742E - 1 

4.423164 E - 

1 

3 

1.302358 

8.633304E - 1 

1.088749E - 

1 

H 0 

= 6.713267E - 3 





■ Solution 


From Eqs. (11.9) and (11.10) 


H Al (s) = 


n 


j =i 


i 

boj + bijS + s 2 


H a2 (s) = 


n 


7=1 


1 

aoj + s 2 


The design can be accomplished by using the following procedure: 

1. Find the poles and residues of H A \(s) and //, A 2 (•'>')- 

2. Form Hoi(z) and Hm{z) using Eqs. (11.12) and (11.13). 

3. Replace zeros of Niiz.) outside the unit circle by their reciprocals. 

4. Adjust constant Hq to achieve zero minimum passband loss. 
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Table 11.3 Coefficients of H D {z) (Example 11.2) 


J «o j «ij hj b\j 


1 1.0 
2 1.0 

3 1.0 

4 3.248990E + 1 

5 1.331746E-2 


1.942528 
-7.530225E - 1 
-1.153491 
1.955491E+ 1 
3.971465E- 1 


4.508735E - 1 
6.903732E - 1 
9.128252E- 1 
5.611278E - 2 
5.611278E - 2 


-1.281134 
-1.303838 
-1.362371 
7.751650E - 1 
7.751650E - 1 


H 0 = 3.847141 Zs — 4 


With this procedure Ho(z) can be deduced as 


5 

H d (z)=H 0 ]J 

/=! 


aoj + a\jZ + z 2 
bo j + bijz + Z 2 


where Ho, a,j , and bij are given in Table 11.3. 

The loss characteristic achieved, plotted in Fig. 1 1.3 a and b, is seen to be a faithful 
reproduction of the analog loss characteristic. For this filter, the conventional invari¬ 
ant impulse-response method gives unsatisfactory results because the assumptions of 
Eqs. (11.3a) and (11.4) are violated. 



Figure 11.3 Examples 11.2 and 11.4: (a) Stopband characteristics. 

Analog filter; o o o modified impulse-invariant response method; 
matched-z transformation method. 
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Figure 11.3 Cont’d Examples 11.2 and 11.4: (b) Passband characteristics. 
— Analog filter; o o o modified impulse-invariant response method; 
-matched-z transformation method. 


11.5 MATCHED-Z TRANSFORMATION METHOD 


An alternative approximation method for the design of recursive filters is the so-called matched-z 
transformation method [5, 9]. In this method, given a continuous-time transfer function like that in 
Eq. (11.8), a corresponding discrete-time transfer function can be formed as 


H d (z) = (z + \) l 


Hollis ~e* T ) 
nf=i (z-e» T ) 


(11.15) 


where L is an integer. The value of L is equal to the number of zeros at s = oc in ll A (s). Typical 
values for L are given in Table 11.4. 

The matched-z transformation method had little or no theoretical foundation when it first found 
its way into the technical literature. It was probably observed that in the invariant impulse-response 
method, the ith pole of the digital filter, p[, is related to the ith pole of the analog filter, through 
the relation 


It did not take too long for someone to attempt to map the zeros of the analog filter in the same way 
by letting 
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Table 11.4 Typical values of L in Eq. (11.15) 


Type of filter 

Lowpass 

Highpass 

Bandpass 

Bandstop 

Butter worth 

N 

0 

N/2 

0 

Chebyshev 

N 

0 

N/2 

0 

Inverse-Chebyshev, 

N odd 

1 

0 

N/A 

N/A 

N even 

0 

0 

1 for N/2 odd 

0 for N/2 even 

0 

Elliptic, 

N odd 

1 

0 

N/A 

N/A 

N even 

0 

0 

1 for N/2 odd 

0 for N/2 even 

0 


This matched-- transformation seemed to work for highpass and bandstop filters and to make the 
method work for lowpass and bandpass filters as well the fi ddle factor’ (z + 1) L was introduced, 
which improved the situation. 

If we now compare Eqs. (11.14) and (11.15), we note that the only difference between the 
transfer function of the modified invariant impulse-response method and the matched-' transforma¬ 
tion method is that the ratio of polynomials, Ni(z)/N 2 (z), in Eq. (11.14) is replaced by the factor 
(' + \) L . For the standard filter approximations, it turns out that 


Ndz) 

N 2 (z ) 


(z + D L 


and this is why the matched-" transformation method works as well as it does. 

Note that the matched-/ transformation method cannot control the level of the amplitude 
response, i.e., if one starts with an analog filter that has a maximum passband gain of unity, the 
maximum passband gain in the derived digital filter is always something other than unity and, 
therefore, a correction is necessary after the design is completed to restore the maximum passband 
gain to unity. This can be easily achieved by finding the maximum passband gain of the derived digital 
filter, say, M max , and then changing the multiplier constant in Eq. 11.15 from Hq to //,, = Hq/M max . 

The method is fairly simple to apply and gives reasonable results provided that a sufficiently 
large sampling frequency is used. Its main disadvantage is that it introduces a relatively large error 
in the passband loss as will be seen in the following example. 


Example 11.3 


The transfer function 


where 


H a (s) = 


HqS A 

n}=i(* - p;)o - PV 


Hq = 0.9885531 Pi, p* = -2.047535 ± j 1.492958 
p 2 , p * 2 = -0.3972182 ± jl.688095 
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represents a highpass Chebyshev filter with a passband edge of 2 rad/s and a passband ripple 
of 0.1 dB. Obtain a corresponding discrete-time transfer function employing the matched-:; 
transformation method. Use a sampling frequency of 10 rad/s. 


■ Solution 


The value of L in Eq. (11.15) is generally zero for highpass filters, according to Table 
11.4. Hence Hn(z) can be readily formed as 


where 


H d (z) = H 0 


(1-2 z + z z ) 


2\2 


U'i=i( b 0 j +bijz + z 2 ) 


b 0 i = 7.630567 x 10" 2 b n = -3.267079 x 10~‘ 

b 02 = 6.070409 x 10" 1 b n = -7.608887 x 10’ 1 

H 0 = 2.076398 x 10” 1 


The above value of Hq was chosen to give a maximum passband gain of unity, which 
corresponds to a minimum passband loss of zero dB. The loss characteristic of the derived 
filter is compared with that of the analog filter in Fig. 11.4. 



Figure 11.4 Loss characteristic (Example 11.3). 
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Example 11.4 


Redesign the lowpass filter of Example 11.2 employing the matched-j trans¬ 
formation method. 


■ Solution 


From Eq. (11.15) Ho(z) can be formed as 


3 

Hn(z) = H 0 

i=i 


aoj + a\jZ + z 2 
boj + bijz + z 2 


where a\j and h \are given by the first three rows in Table 11.3. For zero minimum 
passband loss, Hq is given by 

H 0 = 8.605074 x 10“ 3 

The loss characteristic achieved is shown in Fig. 11.3 (dashed curve). As can be 
seen, it is significantly inferior to the loss characteristic obtained by using the modified 
invariant impulse-response method. However, as was mentioned earlier, the latter method 
leads to a higher-order transfer function which is more uneconomical. 


11.6 BILINEAR-TRANSFORMATION METHOD 

In the approximation method of Sec. 11.3, the derived digital filter has exactly the same impulse 
response as the original analog filter for t — nT. An approximation method will now be described 
whereby a digital filter is derived that has approximately the same time-domain response as the 
original analog filter for any excitation. 


11.6.1 Derivation 


Consider an analog integrator characterized by the transfer function 


H ai (s) = - 
s 

and assume that its response to an excitation x(t ) is y(t), as depicted in Fig. 11.5. 
The impulse response of the integrator is given by 


£~ 1 H I (s) = h I (t) = 


for t > 0+ 
for t < 0- 


(11.16) 


x(t) o- 



o y(t) 


Figure 11.5 Analog integrator. 
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and its response at instant 1 to an arbitrary right-sided excitation x(t), i.e., x(t) = 0 for t < 0, is 
given by the convolution integral (see Theorem 2.14) 

y(t) = / x(r)hi(t — r) dr 


(see Sec. 10.2.4). If0+ < t\ < t 2 , we can write 


rt 2 rh 

y(t 2 )-y(h)= / x(r)h r (t 2 - r) dr - / x(r)/i / (r 1 - r) dr 
Jo Jo 


For 0+ < r < t\, t 2 


and thus Eq. (11.17) simplifies to 


As t\ —*■ t 2 , from Fig. 11.6 


hj(t 2 - r) = h r (ti - r) = 1 


y(h) - y(h) = / x(r) dr 


y(t 2 ) ~ y(h) ~ t ~ . r ‘ [x(ti) + x(t 2 )] 


and on letting t\ = nT — T and t 2 = nT the difference equation 


(11.17) 


y(nT) - y(nT - T) = -[x(nT - T) + x(nT )] 

can be formed. This equation represents a ‘digital integrator that has approximately the same time- 
domain response as the analog integrator for any excitation. By applying the z transform, we obtain 

Y(z) - z-'Yiz) = ^[z-'Xiz) + X(z)] 
and hence the transfer function of the digital integrator can be derived as 

„ r , Y(z) T (z+V 
H di (z ) = 


X(z) 2 \ z - 1 


The above equation can be expressed as 


H di (z) = ~ 

s 


S-- (z ~ X 


T \z+ 1 


(11.18) 



Figure 11.6 Response of analog integrator. 











DESIGN OF RECURSIVE (HR) FILTERS 543 


and, therefore, from Eqs. (11.16) and (11.18), we have 


H di (z) = H ai {s) 



s= 


In effect, a digital integrator can be obtained from an analog integrator by simply applying the bilinear 
transformation 2 



(11.19) 


to the transfer function of the analog integrator. As T 0, the shaded area in Fig. 11.6 would tend 


to approach the area under the curve and, consequently, the time-domain response of the digital 
integrator would tend to approach that of the analog integrator, as may be expected. 

Applying the bilinear transformation to the transfer function of an arbitrary analog filter will 
yield a digital filter characterized by the discrete-time transfer function 



( 11 . 20 ) 


The digital filter so obtained will produce approximately the same time-domain response as the 
analog filter from which it is derived for any excitation. Furthermore, the time-domain response of 
the digital filter would tend to approach that of the analog filter as T —> 0. 

The above time-domain analysis led to a transformation that can be used to obtain a digital 
filter from an analog one. All we know at this point is the relationship between the time-domain 
response of the digital filter with that of the analog filter. To make further progress, we must deduce 
the relationship between the frequency-domain response of the digital filter with that of the analog 
filter, and to do that we must examine the mapping properties of the bilinear transformation. 

11.6.2 Mapping Properties of Bilinear Transformation 

Equation (11.19) can be put in the form 


2/T + s 
2/T-s 


and with s = er + ja> we have 


z = re 


where 



and 


9 = tan 


-t 



-l m 
2/7-er 


( 11 . 21 ) 


-The bilinear transformation is one of the standard conformal transformations (see Sec. A.9). 
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Clearly 

if a > 0 then r > 1 

if a = 0 then r = 1 

if a < 0 then r < 1 

i.e., the bilinear transformation maps 

1 ) the open right-half s plane onto the region exterior to the unit circle |z| = 1 of the z plane, 

2 ) the j axis of the .v plane onto the unit circle |z| = 1, and 

3) the open left-half .v plane onto the interior of the unit circle z = 1. 

For <7 = 0, we have r = 1, and from Eq. (11.21)0 = 2 tan _1 (®7/2). Hence 

if a> = 0 then 6=0 
if u> —> +oo then 6 -* +7T 

if u> —>■ —oo then 6 —*■ —it 

i.e., the origin of the s plane maps onto point (1, 0) of the z plane and the positive and negative j axes 
of the ^ plane map onto the upper and lower semicircles |z| = 1, respectively. The transformation is 
illustrated in Fig. 11.7a and b. 

From Property 2 above it follows that the maxima and minima of will be preserved 

in \Ho(ei QT )\. Also if 

< \H A (ja>)\ < M 2 

for some frequency range a>\ < co < o> 2 , then 

M\ < \H D (e jQT )\ < M 2 

for a corresponding frequency range £2i < < £l 2 . Consequently, passbands or stopbands in the 

analog filter translate into passbands or stopbands in the digital filter. 




(«) 


Figure 11.7 Bilinear transformation: (a) Mapping fromto z plane. 
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Figure 11.7 Cont’d Bilinear transformation: ( b ) Mapping of amplitude response of analog filter to the z 
domain. 

From Property 3 it follows that a stable analog filter will yield a stable digital filter, and since the 
transformation has real coefficients, Ho(z) will have real coefficients. Finally, the numerator degree 
in Ho (z.) cannot exceed the denominator degree and, therefore. Hr, (z) is a realizable transfer function. 


11.6.3 The Warping Effect 

Let a and Q represent the frequency variable in the analog filter and the derived digital filter, 
respectively. From Eq. (11.20) 


H D (e jnT ) = H A (jco) 
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provided that 


For £2 < 0.3 /T 



to ^ Q. 


( 11 . 22 ) 


and, as a result, the digital filter has the same frequency response as the analog filter. For higher 
frequencies, however, the relation between to and Q becomes nonlinear, as illustrated in Fig. 11.8, 
and distortion is introduced in the frequency scale of the digital filter relative to that of the analog 
filter. This is known as the warping effect [2, 5]. 

The influence of the warping effect on the amplitude response can be demonstrated by consid¬ 
ering an analog filter with a number of uniformly spaced passbands centered at regular intervals, as 
in Fig. 11.8. The derived digital filter has the same number of passbands, but the center frequencies 
and bandwidths of higher-frequency passbands tend to be reduced disproportionately, as shown in 
Fig. 11.8. 

If only the amplitude response is of concern, the warping effect can for all practical purposes 
be eliminated by prewarping the analog filter [2, 5]. Let u>\, a> 2 , . . . , w,, ... be the passband and 
stopband edges in the analog filter. The corresponding passband and stopband edges in the digital 



Figure 11.8 Influence of the warping effect on the amplitude response. 
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filter are given by Eq. (11.22) as 

£2, = ^ tan -1 fort = 1,2,... (11.23) 

Consequently, if prescribed passband and stopband edges £2i, • • • , £2,-, ... are to be achieved in 

the digital filter, the analog filter must be prewarped before application of the bilinear transformation 
to ensure that 


a>i 



(11.24) 


Under these circumstances 


Q, = 

according to Eqs. (11.23) and (11.24), as required. 

The bilinear transformation together with the prewarping technique is used in Chap. 12 to 
develop a detailed procedure for the design of Butterworth, Chebyshev, inverse-Chebyshev, and 
elliptic filters satisfying prescribed loss specifications. 

The influence of the warping effect on the phase response can be demonstrated by considering 
an analog filter with linear phase response. As illustrated in Fig. 11.9, the phase response of the 
derived digital filter is nonlinear. Furthermore, little can be done to linearize it except by employing 
delay equalization (see Sec. 12.5.1). Consequently, if it is mandatory to preserve a linear phase 
response, the alternative methods of Secs. 11.3-11.4 should be considered. 


Example 11.5 


The transfer function 


Ha(s) = 


n 


j =i 


a 0j + s 2 
b 0j + b\jS + j 2 


where ao ; and h, ; are given in Table 11.5, represents an elliptic bandstop filter with a passband 
ripple of 1 dB and a minimum stopband loss of 34.45 dB. Use the bilinear transformation to 
obtain a corresponding digital filter. Assume a sampling frequency of 10 rad/s. 


Table 11.5 Coefficients of H A (s) (Example 11.5) 


j 

a 0j 

b 0 j 

K 

1 

6.250000 

6.250000 

2.618910 

2 

8.013554 

1.076433E+ 1 

3.843113E- 1 

3 

4.874554 

3.628885 

2.231394E- 1 
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Figure 11.9 Influence of the warping effect on the phase response. 

■ Solution 

From Eq. (11.20), one can show that 

T-r fln; + a '\ J-Z + a o /Z 2 

H D (z) = U^t J J 


7=1 b' 0j +b[jZ + z 2 


where 


, a 0j +4/T 2 , 2(a 0j -4/T 2 ) 

a 0j ~ ... a ij ~ ... 

L J C J 

b 0j -2bij/T + 4/T 2 2(b 0j 

b 0j = ~ - - - b xj = - L 

L j 

2b Xi 4 
C J - boj + — + j! 


4 /T 1 ) 
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The numerical values of ah and b' IJ are given in Table 11.6. The loss characteristic of the 
derived digital hlter is compared with that of the analog filter in Fig. 11.10. The expected 
lateral displacement in the characteristic of the digital filter is evident. 


Table 11.6 Coefficients of H D (z) (Example 11.5) 


i 

<j 

a y 

Kj 



l 

6.627508E - 1 

-3.141080E - 

1 3.255016E - 1 

-3.141080E 

- 1 

2 

8.203382E - 1 

— 1.915542C - 

1 8.893929 E - 1 

5.716237E 

-2 

3 

1.036997 

—7.266206 E - 

1 9.018366E - 1 

— 8.987781 Zi 

- 1 



11.7 DIGITAL-FILTER TRANSFORMATIONS 

A normalized lowpass analog hlter can be transformed into a denormalized lowpass, highpass, band¬ 
pass, or bandstop hlter by employing the transformations described in Sec. 10.8. Analogous transfor¬ 
mations can be derived for digital hlters as we shall now show. These are due to Constantinides [12]. 


11.7.1 General Transformation 


Consider the transformation 


z = /(z) = e J?Jr 

1 = 1 


z — af 
1 — a t z 


(11.25) 
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where £ and m are integers and a* is the complex conjugate of a,. With z. = Re J '~ rr , z = re 1 "' 1 * and 
a ; = ae Eq. (11.25) becomes 


Re jnr = \ 

i = 1 


re i<oT - ae-M 


1 - rc i eR wT+ 'l r ‘'> 


and hence 

^2 _ TT >' 2 + c f ~ 2rc i COSjcoT + \jfj) 

1 + ( rci ) 2 — 2 rcj cos (cuT + i/f,) 


Evidently, 


if R > 1 

then r 2 + cf > 

1 + ( rdf 

or 

r > 1 

if R = 1 

then r 2 + c 2 = 

1 + (r Ci ) 2 

or 

/• = 1 

if R < 1 

In effect, Eq. (11.26) maps 

then r 2 + cf < 

1 + ( rdf 

or 

r < 1 


1. the unit circle |z| = 1 onto the unit circle |z| = 1 , 

2. the interior of |z| = 1 onto the interior of |z| = 1, and 

3. the exterior of |z| = 1 onto the exterior of |z| = 1 


as illustrated in Fig. 11.11. 

Now consider a normalized lowpass filter characterized by // v (z) with a passband extending 
from 0 to Q p . On applying the above transformation we can form 


H(z) = H n (z ) 


z=f(z ) 


(11.27) 


With the poles of H N (z), located inside the unit circle |z| = 1, those of H(z) will be located inside 
the unit circle |z| = 1; that is, H(z) will represent a stable filter. Furthermore, from item 1, if 

Mi < \H N (e jnT )\ < M 2 




Figure 11.11 General z-domain transformation. 
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for some frequency range Q| < Q < Qi, then 

Mi < \H(e j(oT )\ < M 2 

for one or more corresponding ranges of co; that is, the passband (stopband) in //y(z) will translate 
into one or more passbands (stopbands) in //(I). Therefore, the above transformation can form the 
basis of a set of transformations that can be used to derive transformed lowpass, highpass, bandpass, 
and bandstop digital filters from a given lowpass digital filter. 


11.7.2 Lowpass-to-Lowpass Transformation 

The appropriate values for £, m, and a, in Eq. (11.25) can be determined by examining the details of 
the necessary mapping. If H(z) is to represent a lowpass filter with a passband edge o> p , the mapping 
must be of the form shown in Fig. 11.12a, where solid lines denote passbands. As complex number 
e jnr traces the unit circle in the z plane once, e J0lT must trace the unit circle in the z plane once in 
the same sense. The transformation must thus be bilinear (m = 1) of the form 


z = 




z — a* 
1 — az 


At points A and A',z = Z 



z plane 


cl 

C2 p \ 

\A 


-v 

l |\ 




= 1, and at C and C', z = z = —1 Hence Eq. (11.28) gives 

1 = e it* LlHi. an d l = eJC* 

l — a 1 + a 



(11.28) 


Figure 11.12 (a) Lowpass-to-lowpass transformation, (b) lowpass-to-bandstop transformation. 
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By solving these equations, we obtain 

a — a* = a £ = 0 


where a is a real constant. Thus Eq. (11.28) becomes 

z — a 

z = 1-- 

1 — az 


The necessary value for a can be determined by noting that at points B and B', we have £2 = Q p 
and co — u> p , in which case 


gjQpT __ 


e jMpT _ a 

1 — aej m P T 


a _ sin[(^ p -co p )T/ 2] 
sin[(£2 p + co p )T/2\ 


11.7.3 Lowpass-to-Bandstop Transformation 

If a bandstop filter is required with passband edges co p \ and co p 2 , the mapping must have the form 
shown in Fig. 11.12 b. In order to introduce an upper passband in fl(z), e J '~ rr must trace the unit 
circle of the z plane twice for each revolution of e ]0,T in the z plane. Consequently, in this case, the 
transformation must be biquadratic ( m — 2) of the form 

. = c x* z 2 + fc + y 

1 + Pz + yz 2 

where fi and y are real constants. At points A and A',z = Z = 1 and 

e Kn = , 

so that 

^ _ z 2 + Pz + y 
l + Pz + yz 2 

With z = e jSiT and z — e ja>T 

jnT _ e j 2a,T + pei“ T + Y 

~ e j2a>T( e -j2coT + p e ~jo>T + y) 


Hence 


£2T 


and after some manipulation 


= tan 


tan 


sin 2 coT + sincuT 
cos 2 coT + p cos coT + y 

£2T (1 — y) sin wT 

(1 + y)cosa>T + 


coT 
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At points B and B ', Q = Q p and a> = co p \, respectively, and as a result 

(1 - y) sina>piT 


tan 


Q p T 


2 (1 + y) cos aipiT + 

Likewise, at points D and /)', Q = and co — co p 2 , respectively, so that 

(1 - y)smco p2 T 


tan 


-Sl P T 


2 (1 + y) cos cl> p2 T + p 

Now by solving Eqs. (11.29) and (11.30), ft and y can be deduced as 


2a 
1 +k 


1 -k 
1 +k 


where 


cos[(ujp2 + co p i)T/2\ 
cos[(tt ) p 2 - w p i)T/2] 


A 1 (Op2 — a> p i)T 

and k = tan —-— tan — - --- 

2 2 


(11.29) 


(11.30) 


Lowpass-to-highpass and lowpass-to-bandpass transformations can similarly be derived. The 
complete set of transformations is summarized in Table 11.7. 


Table 11.7 Constantinides transformations 


Type 


Transformation 

a,k 

LP to LP 


Z — Oi 

sin[(£ 2 p - to p )T/ 2 ] 


1 — az 

sin[(S 2 p + co p )T/ 2 ) 

LP to HP 


Z — a 

cos[(^2 p — co p )T /2] 


1 — az 

cos[(fip + co p )T/ 2 ] 

LP to BP 


, 2 ak k — 1 

Z - 7- -Z + - -7 

k + 1 k + 1 

cos[((W p2 + cOpi)T/ 2 ] 


2 ak k — 1 1 

1 , . 2 - 4 *. . Z 

k + 1 k + 1 

cos[(cu p2 - co p i)T/ 2 ] 

£l p T (a > P 2 - a> p \)T 

k = tan —-— cot — - - - - 

2 2 


2a 1 — k 

- _ 7 _ 

1 + k^ 1 + k _ cos[(ffi>p 2 + (Op\)T/2\ 

2a - . 1 ~ k -2 01 cos[(co p 2 - co pl )T/2] 

1 +k 1 +k 
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11.7.4 Application 

The Constantinides transformations can be readily applied to design filters with prescribed passband 
edges. The following procedure can be employed: 

1. Obtain a lowpass transfer function using any approximation method. 

2. Determine the passband edge Q, p in H N ( 7 ,). 

3. Form H ( 7 ) according to Eq. (11.27) using the appropriate transformation. 

An important feature of filters designed by using this procedure is that the passband edge in 
lowpass or highpass filters can be varied by varying a single parameter, namely, a. Similarly, both 
the lower and upper passband edges in bandpass or bandstop filters can be varied by varying only a 
pair of parameters, namely, a and k [13]. 

An alternative design procedure by which prescribed passband as well as stopband edges can 
be achieved is described in Chap. 12. 


11.8 COMPARISON BETWEEN RECURSIVE AND 
NONRECURSIVE DESIGNS 

Before a solution is sought for the approximation problem, a choice must be made between a recursive 
and a nonrecursive design [14]. In recursive filters the poles of the transfer function can be placed 
anywhere inside the unit circle. A consequence of this degree of freedom is that high selectivity 
(i.e., narrow transition bands) can easily be achieved with low-order transfer functions. In nonrecur¬ 
sive filters, on the other hand, with the poles fixed at the origin, high selectivity can be achieved only 
by using a relatively high order for the transfer function. For the same filter specification the required 
order in a nonrecursive design can be as high as 5 to 10 times that in a recursive design. For example, 
the bandpass-filter specification in Example 9.5 can be met using a nonrecursive filter of order 52 
or a recursive elliptic filter of order 8. In practice, the cost of a digital filter tends to increase and its 
speed tends to decrease as the order of the transfer function is increased. Hence, for higli-selectivity 
applications where the delay characteristic is of secondary importance, the choice is expected to be 
a recursive design. 

Constant group delay is mandatory for certain applications, e.g., in data transmission and 
image processing (see Sec. 5.7). For such applications, the choice is between a nonrecursive design 
and an equalized recursive design. If computational efficiency is unimportant (e.g., if the amount of 
data to be processed is small), a nonrecursive design based on the methods considered in Chap. 9 
may be entirely acceptable. However, if computational efficiency is of prime importance (e.g., in 
real-time applications or in applications where massive amounts of data are to be processed), an 
optimal nonrecursive design based on the Remez exchange algorithm described in Chap. 15 or an 
equalized recursive design based on the method of Sec. 16.8 must be selected. Optimal nonrecursive 
designs are easier to obtain than equalized recursive designs. However, computational efficiency is 
significantly better in equalized recursive designs, particularly if a high selectivity is required. 

Nonrecursive filters are naturally suited for certain applications, e.g., to perform numerical 
operations like interpolation, extrapolation, differentiation and integration. Further, owing to the fact 
that their impulse response is of finite duration, nonrecursive filters can be implemented in terms of 
fast-Fourier transforms without the need for a window function (see Sec. 7.8.). 
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In certain applications, the choice between a nonrecursive and a recursive design may be 
determined by other factors. For example, nonrecursive filters are always stable, owing to the absence 
of feedback, and this feature alone makes them the filters of choice for the implementation of adaptive 
filters (see Sec. 18.5). In these applications, the characteristics of the adaptive filter change with 
time on-line and if it is possible for the filter to become unstable, it will at some point. Recursive 
filters can also be used as adaptive filters but a special mechanism has to be incorporated in the 
filter implementation to prevent instability from arising. Nonrecursive filters tend to be relatively 
insensitive to quantization errors. In addition, their realizations are simple and regular and are highly 
attractive for very-large-scale integrated circuit implementation (see Sec. 8.3). 
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PROBLEMS 


11.1. By using the invariant impulse-response method, derive a discrete-time transfer function from the 
continuous-time transfer function 


H a {s) = 


1 


(s + l)(s 2 + s + 1) 

The sampling frequency is 10 rad/s. 

11.2. A continuous-time system is characterized by the transfer function 

1 


H a {s) = 


s 3 + 6 s 2 + llj + 6 


By using the invariant impulse-response method, obtain the transfer function of a corresponding discrete¬ 
time system. The sampling frequency is 6 n. 

11.3. A continuous-time system has a transfer function 

5.0 5s + 13 

H a (s) =-=■ 

s + 2.5 i 2 +4i+ | 

Using the invariant impulse-response method, obtain the transfer function of a corresponding discrete¬ 
time system. The sampling frequency is 20 rad/s. 

11.4. A Bessel-Thomson normalized lowpass filter has a transfer function 

RqRi R* 


Li 

H a (s) = -— +-— + 

s - Po s - Pi s - pi 


where 


R 0 = 4.53, po = -2.32 

Ri = -2.26- j 6.24, Pl = -1.84 + j 1.75 

(a) Using the invariant impulse-response method, obtain the transfer function of a corresponding digital 
filter. The sampling frequency is 20 rad/s. 

(b) Give an approximate expression for the frequency response of the digital filter in terms of the 
frequency response of the analog filter, H A (ja>), and state what determines the accuracy of your 
expression. 

11.5. The sixth-order normalized Bessel-Thomson transfer function can be expressed as 

3 


H A (S) = Y, 


R, 


+ 


Rf 


s- Pi s- pl 


where R t and p, are given in Table PI 1.5. 

(a) Design a digital filter by using the invariant impulse-response method, assuming a sampling fre¬ 
quency of 10 rad/s. 

( b) Plot the phase response of the digital filter. 


Table PI 1.5 


i 

Pi 

Ri 

i 

-4.248359 + ;0.867510 

10.95923 - ;39.42517 

2 

-3.735708 + y2.626272 

-14.12677+ /12.70117 

3 

-2.515932+ /4.492673 

3.16754- 70.202460 
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11.6. A continuous-time system has a transfer function 


H a (s) = 


s 2 — 3s + 3 
.s 2 + 3s + 3 


(a) Find the amplitude response. 

(b) Can one design a corresponding discrete-time system by using the invariant impulse-response 
method? If so, carry out the design employing a sampling frequency of 10 rad/s. Otherwise, explain 
the reasons for the failure of the method. 


11.7. A lowpass digital filter that would satisfy the specifications of Fig. PI 1.7 is required. 

(a) Obtain a design by applying the invariant impulse-response method to an appropriate Chebyshev 
approximation. The sampling frequency is 20,000 rad/s. 

( b) Check your design by plotting the amplitude responses of the original analog filter and the designed 
digital filter. 









30 

1 



| 0 - 5 : 

| | co, rad/s 


1000 2000 


Figure P11.7 

11.8. A bandpass filter is required with passband edges of 900 and 1600 rad/s and a maximum passband loss of 
1.0 dB. Obtain a design by employing the invariant impulse-response method. Start with a second-order 
normalized lowpass Chebyshev approximation and neglect the effects of aliasing. A suitable sampling 
frequency is 10,000 rad/s. 

11.9. Given an analog filter characterized by 


H a (s) = 


Ri 


7 = 1 s - p< 

a corresponding digital filter characterized by H D (z) can be derived such that 


1Z A u(t)\ = !Z D u{nT) 

\t=nT 


This is called the invariant unit-step-response approximation method [15, 16]. 
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(a) Show that 


if co <$; 1 / T and 


(. b ) Show that 


H D {e^ T ) « H A <jco) for \a>\ 


Ha(Joi) co s 

— ; - ^ 0 for |o>| > — 

ja> 2 




r : 


z — e Pi ' 


, (e p ' r — 1)/?, 
where R , = - 


11.10. (a) Design a third-order digital filter by applying the invariant unit-step-response method (see Prob. 11.9) 

to the transfer function in Prob. 11.1. Assume that a> s = 10 rad/s. 

(b) Compare the design with that obtained in Prob. 11.1. 

11.11. Given an analog filter characterized by 


H a (s) = H 0 + Y, 


Ri 


i s ~ Pi 


a corresponding digital filter characterized by Hd(z) can be derived such that 
lZ A u(t) sinroo/ ='lZ D u{nT)smco( i nT 

\t=nT 


This is the so-called invariant sinusoid-response approximation method [17]. 
(a) Show that 


H D {e^ T ) 


2<wo(cos aiT — cos cl>qT) 
(wq — ar)T sinwoT 


H A (jm ) 


CO. 

for |ft>| < — 
2 


if ai <£ l/T and 

( b ) Show that 


where 


(Qq H A (jco) 
a>l — a> 2 


for |cu| > 


to s 
~2 


N 

Hd(z) = Up + 

i=l 


Utz+Vj 
z — e p ‘ T 


Uj = ( a> 0 e PiT — Pi sintuoT — a > 0 cos a> 0 T)R' j 
Vi = [e PiT (pi sincuoT — a>ocosa>oT) + a>p\R’i 
, Ri 

R = - t- - 

(p- + tUo)sintt> 0 r 


11.12. (a) Redesign the filter of Prob. 11.1 by employing the invariant sinusoid-response method (see 

Prob. 11.11). The value of a>p may be assumed to be 1 rad/s. 

(b) Plot the resulting phase response. 

11.13. Design a lowpass filter that would satisfy specifications of Fig. PI 1.7 by applying the modified invariant 
impulse-response method to a suitable elliptic approximation. The sampling frequency is 20,000 rad/s. 
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11.14. A given third-order lowpass Chebyshev filter has a transfer function 


H(s) = 


_ Ho _ 

(s - p 0 )(s - Pi)(s - p\) 


where H 0 = 0.49, po — —0.494, pi = —0.247 + j 0.966, and p\ is the complex conjugate of p^. 

(a) Obtain a corresponding discrete-time transfer function using the matched-z transformation method 
assuming a sampling frequency of 20 rad/s. 

(b) What are the advantages and disadvantages of the matched-z transformation method and the invariant 
impulse-response method? 

11.15. (a) Design a digital filter by applying the matched-z transformation method to the inverse-Chebyshev 

filter of Example 10.5 assuming a sampling frequency of 20 rad/s. 

( b ) Check your design by plotting the amplitude responses of the original analog filter and the designed 
digital filter. 

11.16. An analog elliptic lowpass filter with a passband edge a> p = 0.7075 rad/s has a transfer function of the 
form 


0.07488(s 2 + 2.577) 

“ (s + 0.3818)O 2 + 0.3069.? + 0.5053) 

(a) Obtain a continuous-time highpass transfer function with the same passband edge. 

(b) Obtain a corresponding discrete-time highpass transfer function using the matched-z transformation 
method. The sampling frequency is 20 rad/s. 

11.17. Design a lowpass filter that would satisfy the specifications of Fig. PI 1.7 by applying the matched- 
z transformation method to an appropriate Chebyshev approximation. The sampling frequency is 
20,000 rad/s. 

11.18. Design a highpass filter that would satisfy the specifications of Fig. PI 1.18. Use the matched-z trans¬ 
formation method along with an elliptic approximation. Assume that a> s = 6000 rad/s. 







o 
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Figure P11.18 
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11.19. 


11 . 20 . 

11 . 21 . 

11 . 22 . 

11.23. 


11.24. 

11.25. 


11.26. 


11.27. 

11.28. 

11.29. 

11.30. 


(a) Obtain a digital-filter network by applying the bilinear transformation to the transfer function 

s 2 

Ha(s) = ---- 

s~ + V2s + 1 


(b) Evaluate the gain of the filter for a> — 0 and a> = n/T. 

(a) Obtain a discrete-time transfer function by applying the bilinear transformation of the transfer 
function of Prob. 11.1. The sampling frequency is 47r rad/s. 

( b) Determine the gain and phase-shift of the filter at a> = 0 and co — n rad/s. 

Design a digital filter by applying the bilinear transformation to the Chebyshev transfer function of 
Example 10.3. The sampling frequency is 10 rad/s. 

Design a digital filter by applying the bilinear transformation to the inverse-Chebyshev transfer function 
of Example 10.5. The sampling frequency is 20 rad/s. 

The lowpass transfer function of Example 10.6 is subjected to the bilinear transformation. 

(a) Assuming that a> s = 10 rad/s, find the resulting passband and stopband edges and also the infinite- 
loss frequencies. 

( b ) Determine the effective selectivity factor 3 for the digital filter designed. 

(c) Find the minimum value of a> s if the passband and stopband edges in the digital filter are to be within 
±1 percent of the corresponding values in the analog filter. 

Redesign the highpass filter in Prob. 11.16, part (a), using the bilinear transformation. 

An analog elliptic lowpass filter has the following specifications: 

• Passband edge a> p = 0.6325 rad/s 

• Stopband edge co a = 1.5811 rad/s 

• Maximum passband loss = 0.5 dB 

• Minimum stopband loss = 37.7 dB 

The filter is characterized by the transfer function 

0.05917C? 2 + 3.2634) 

* ~ (s + 0.4209)(s 2 + 0.3618.? + 0.4587) 

(a) Design a corresponding lowpass digital filter using the bilinear-transformation method assuming a 
sampling frequency of 2n rad/s. 

( b ) Find the passband and stopband edges of the digital filter. 

(c) Find the maximum passband loss and minimum stopband loss of the digital filter. 

(a) Obtain a continuous-time fourth-order highpass transfer function with a 3-dB cutoff frequency at 
1 rad/s using the Butterworth approximation. 

( b ) Obtain a corresponding discrete-time transfer function using the bilinear transformation. Assume a 
sampling frequency of 10 rad/s. 

(c) Determine the exact 3-dB cutoff frequency of the digital filter. 

Derive the lowpass-to-highpass transformation of Table 11.7. 

Derive the lowpass-to-bandpass transformation of Table 11.7. 

H d (z) represents a lowpass filter with a passband edge £2 p . Show that H D (—z ) represents a highpass 
filter with a passband edge — oo s /2. 

The transfer function 

™=*h v: i t z+ ?f 

b 0j +b ljZ + z 2 


3 This is the ratio of the actual passband edge to the actual stopband edge. 
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where a t j and b t j are given in Table PI 1.30, represents a lowpass digital filter with a passband edge 
of 1 rad/s if a> s = 2jt rad/s. By using the lowpass-to-highpass transformation in Table 11.7, design a 
highpass filter with a passband edge of 2 rad/s if a> s = 2jr rad/s. 


Table P11.30 


j 

fl o j 

«i j 

b 0j 

bij 

1 

1.722415£ - 1 

3.4448297? - 1 

4.928309 E - 1 

-1.263032 

2 

1.727860 E - 1 

3.4557207? - 1 

7.8925957? - 1 

—9.7531647? - 1 

Ho 

= 3.500865£ - 1 





11.31. By using the transfer function of Prob. 11.30 obtain a lowpass cascade canonic structure whose passband 
edge can be varied by varying a single parameter. 
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CHAPTER 

12 


RECURSIVE 
(HR) FILTERS 
SATISFYING 
PRESCRIBED 
SPECIFICATIONS 


12.1 INTRODUCTION 

The previous chapter has shown that given an analog filter, a corresponding digital filter can be 
readily obtained by using the bilinear transformation. This design method preserves the maxima and 
minima of the amplitude response and, as a consequence, passbands and stopbands in the analog filter 
translate into corresponding passbands and stopbands in the digital filter; furthermore, the passband 
ripple and minimum stopband attenuation in the analog filter are preserved in the digital filter, and the 
latter filter is stable if the former is stable. Owing to these important advantages, the bilinear transfor¬ 
mation method is one of the most important methods for the design of digital filters, if not the most 
important. As was demonstrated in Chap. 11, the main problem with the method is the so-called warp¬ 
ing effect which introduces frequency-scale distortion. If w \, > ( »i , are the passband and 

stopband edges in the analog filter, then, according to Eq. (11.23), the corresponding passband and 
stopband edges in the derived digital filter are given by 


Qi = 



i = l,2,... 
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Consequently, if prescribed passband and stopband edges S2i, CI 2 , ... , C,, ... are to be achieved, 
the analog filter must be prewarped before the application of the bilinear transformation to ensure 
that its band edges are given by 

2 Q t T 

&>, = — tan- 

T 2 

If this could be accomplished, then the band edges of the digital filter would assume their prescribed 
values Q,- since 


2 co/T 

Qj — — tan 


2 

= — tan 
T 


-1 


2 

T 2 Cl t T 

— ■ — tan- 

2 T 2 


= a 


for i = 1,2,... 


The design of lowpass, highpass, bandpass, and bandstop filters is usually accomplished in 
two steps. First a normalized continuous-time lowpass transfer function is transformed into a denor- 
malized lowpass, highpass, bandpass, or bandstop transfer function employing one of the standard 
analog-filter transformations described in Sec. 10.8. Then the bilinear transformation is applied. 
Prewarping can be effected by choosing the parameters in the analog-filter transformations appro¬ 
priately. 

This chapter considers the details of the above design procedure. Formulas are derived for the 
parameters of the analog-filter transformations for Butterworth, Chebyshev, inverse-Chebyshev, and 
elliptic filters, which simplify the design of digital filters satisfying prescribed specifications [1]. 


12.2 DESIGN PROCEDURE 

Consider a normalized analog lowpass filter characterized by H^is) with a loss 


A n (co) — 20 log 


1 

\H N (jco)\ 


and assume that 


0 < A N (a>) < A p for 0 < \a>\ < w p 
A n (co) > A a for co a < \co\ < 00 

as illustrated in Fig. 12.1. A corresponding denormalized lowpass (LP), highpass (HP), bandpass 
(BP), or bandstop (BS) digital filter with the same passband ripple and the same minimum stopband 
loss can be derived by using the following steps: 

1. Form 


H x (s) = H n (s) 


s — fx(s ) 


( 12 . 1 ) 


where fx(s) is one of the transformations given in Table 12.1 (see Sec. 10.8). 
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Figure 12.1 Loss characteristic of normalized LP analog filter. 


2. Apply the bilinear transformation to H x (s ), that is, 


H d (z) = H x (s ) 




( 12 . 2 ) 


If the derived filter is to have prescribed passband and stopband edges, the parameters A, &>o, and B 
in Table 12.1 and the order of // v (s ) must be chosen appropriately. Formulas for these parameters 
for the various standard types of analog-filter approximations are derived in the following section. 


12.3 DESIGN FORMULAS 


12.3.1 Lowpass and Highpass Filters 

Consider the lowpass-filter specifications of Fig. 12.2, where Q, p and Q a are the desired passband 
and stopband edges, and assume that the above design procedure yields a transfer function Ho(z ) 
such that 


Ad(£ 2) — 20 log \H n {ei ar )\ 

Table 12.1 Standard forms of f x (s) 


X 

fx(s) 

LP 

Xs 


A 

HP 



s 



BP 


B\ s ) 


Bs 

BS 

S 2 + U>Q 
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Figure 12.2 Loss characteristic of LP digital filter. 


where 0 < Ao(£ 2) < A p for 0 < |S2| < £2 p 

Ao(f2) > A a for < |£2| < co s /2 


as shown in Fig. 12.2. 

If we let s = jco and s = ja> in Eq. (12.1), then from Table 12.1 

\H\,v(joS)\ = \H N (jco)\ 

provided that ta = kcb 

Hence co p — ka> p (12.3) 

co a — kd) a (12.4) 

where a> p and w a denote the passband and stopband edges, respectively, in //[ p(.v). If we now let 
Z — e /£r/ and .? = jcb in Eq. (12.2), we get 

\H D (e jQT )\ = \H LP {jd>)\ 

2 ttT 

provided that <x> — — tan — 

2 £2 T 

Thus j tan —(12.5) 

2 £l a T 

co a = — tan 


2 


( 12 . 6 ) 
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and from Eqs. (12.3)—(12.6), we obtain 


co n — —X tan ■ 


oj a = —X tan 


OpT 
2 
Q a T 
2 


(12.7) 

( 12 . 8 ) 


From Eqs. (12.7) and (12.8), parameter X of the lowpass-to-lowpass (LP-to-LP) transformation and 
the selectivity of the normalized analog LP filter can be deduced as 


T (Op 

2 tan (Q p T /2) 


and 


co p tan (Q p r/2) 
co a tan (Q a T/2) 


(12.9) 


( 12 . 10 ) 


respectively. 

The digital LP filter will satisfy the prescribed specifications if we force the actual passband 
and stopband edges Q p and Q a to be equal to the prescribed passband and stopband edges Q p and 
Cl a , respectively, but, in practice, it is usually difficult to fix both the passband and stopband edges at 
the prescribed values. A feasible alternative is to fix the passband edge at the prescribed value and to 
make the stopband edge equal to or less than the prescribed stopband edge. This can be accomplished 
by assigning 


Q p = Q p and 

In this way, the loss at £2 = Q p will be exactly equal to the minimum value specified and the loss at 
£2 = Q a will be equal to or exceed the minimum value specified as can be seen in Fig. 12.2. 

With the above assignment, Eq. (12.9) gives the required value of the LP-to-LP transformation 
as 


T (Op 

2 tan (Ci p T /2) 


On the other hand, Eq. (12.10) gives 


or 


co p tan (Q p T /2) tan (Q p T /2) 
co a tan ( Q a T /2) “ tan(^ fl T/2) 


co p 

co a 


> 


where K () 


tan (Q p T /2) 
tan (Q a T/2) 


( 12 . 11 ) 


The inequality in Eq. (12.11) can be justified by noting that and are both less than the 
Nyquist frequency, co s / 2, and hence the values of Q a T/2 and Q a T/2 are in the range 0 to n/2. 
Since tan (QT/2) is a monotonic increasing function of Q over the range 0 < QT/2 < tt/ 2 or 
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Table 12.2 Lowpass and highpass filters 


LP 

(On 

— >K 0 

CD a 

y _ 

It&nlfilpT /2) 

HP 

CD a K a 


_ 2cd p tan {£l p T /2) 

T 

where 

K tan (ClpT/2) 

tan(L! a 772) 


0 < < cd s / 2 and > Q a , according to the above assignment, it follows that tan (Q a T /2) > 
tan (£l„T /2). This inequality states, in effect, that the selectivity of the normalized analog LP filter, 
(D p /CD a , must be greater than or equal to constant Kq, and this constraint imposes a lower limit on 
the order of Hn(s), as will be shown later. 

The preceding approach can be readily extended to highpass filters. The formulas for A and 
(D p /CD a for LP and HP filters are summarized in Table 12.2. 

12.3.2 Bandpass and Bandstop Filters 

Now consider the bandpass-filter specifications of Fig. 12.3, where Cl p 2 and £2 a i, & a 2 represent 
the desired passband and stopband edges, respectively, and assume that the derived filter satisfies the 



Figure 12.3 Loss characteristic of bandpass digital filter. 
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conditions 


0 < Ao(£2) < A p for Q. p \ < |Q| < £} p2 
Ad(£2) > A a for 0 < |f2| < Q. a \ and £l a2 < |£2| < co s / 2 

as shown in Fig. 12.3. 

From Eq. (12.1) and Table 12.1 


I#bpO'co)| = \H N (jco)\ 


provided that 



and by solving for co, we obtain 



With co = ±co p or ± co a 


( 12 . 12 ) 


the positive passband and stopband edges in H KV (s) can be deduced from Eq. (12.12) as 


B 

(a P i, a>p2 — T~ -F 



and 


oo a B 

1 j — “F ^ T 



respectively. As can be readily verified 

- - 2 

0>plQ>p2 = co 0 

- 2 
0)a\U>a2 = 0} o 

(Op 2 (Op 1 — COpB 
U>a2 — U>a\ — OJ a B 


(12.13) 

(12.14) 

(12.15) 

(12.16) 


From Eq. (12.2) 


\H D (e jnT )\ = \H BP (ja>)\ 


if 


2 

co — — tan- 

T 2 
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and hence 


(Op 1 
(O p 2 
Cbal 
(O a 2 


2 

— tan 
T 

2 

— tan 
T 

2 

— tan 
T 

2 

— tan 
T 


QpiT 

2 

QpiT 

2 

Q. a \T 

2 

Q a iT 

2 


We can now assign 

Qp i — & p i and Qp 2 — ^p 2 

From Eqs. (12.15), (12.17), and (12.18), we obtain 


(12.17) 

(12.18) 

(12.19) 

( 12 . 20 ) 

( 12 . 21 ) 


B = 


2 K a 
T( o p 


( 12 . 22 ) 


where 


Ka = tan 


&p2T 

2 


— tan 


&piT 

2 


Similarly, from Eqs. (12.13), (12.17), and (12.18) 


0)0 = 



(12.23) 


(12.24) 


£l p \T 

where Kg — tan —^— tan —y— (12.25) 

With the passband edge of the normalized LP filter, a> p , the sampling period T(= 2tc/ o> s ). and 
the specified passband edges for the digital filter, and known, parameters B and o>o of the 
LP-to-BP transformation can be determined. 

In order to determine the minimum order of the normalized LP filter that would satisfy the 
specifications, we need to derive an expression for the selectivity of the LP filter as was done in the 
case of lowpass filters in the previous section. From Eqs. (12.13) and (12.14), we have 


(O a \(Oa2 = (Op\(O p 2 

and from Eqs. (12.17)-( 12.20) 

QalT Qa2T Qp\T Qp2T 

tan-tan-= tan — - -tan — - - 

2 2 2 2 

but since the passband edges of the BP digital filter, and Q p 2 , have already been fixed (see 
Eq. (12.21)), the right-hand side of the above equation has also been fixed and, therefore, it is not in 
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general possible to also fix the stopband edges, Q. : ,\ and STL, 2, at the prescribed values. The alternative 
is to find suitable values for STL, i and STL, 2 such that 

and < &a 2 

without violating Eqs. (12.14) and (12.16). In this way, the loss at 12 = STL, i and Q„2 will be equal 
to or exceed the minimum specified values as can be seen in Fig. 12.3. 

If 




then Eq. (12.19) gives 



Sl a \T 

2 



ESfliT 

2 


(12.26) 


since tan(£2T/2) is a monotonic increasing function over the range 0 to co s /2, as was shown in the 
case of LP filters. Let us assume that STL, 2 is chosen such that Eqs. (12.14) and (12.16) are satisfied. 
If we eliminate d > a 2 in Eq. (12.16) using Eq. (12.14) and then eliminate 6 > a \ using Eq. (12.19), we 
get 


_ w o ~ 

“ Bcb a t 

= (o$ — (2/T) 2 tan 2 (£l a \T /2) 
(2fi/r)tan(£2 al r/2) 

Therefore, from Eqs. (12.26) and (12.27), we have 

< tu 5 -( 2 /r) 2 tan 2 (^ fll r/ 2 ) 
(2B/r)tan(£2 al r/2) 

and on eliminating coq and B using Eqs. (12.24) and (12.22), we deduce 


co p 

— >K X 

(On 


(12.27) 


where 


K a tan(Q fl iT/2) 
K b - tan 2 (& al T/2) 


(12.28) 


and constants Ka and Kb are given by Eqs. (12.23) and (12.25), respectively. In other words, in 
order to satisfy the required specifications at the lower stopband edge, STL, | ■ the selectivity of the 
normalized analog LP filter must be equal to or exceed constant K\. 

On the other hand, if 


&a2 < &a2 
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then from Eq. (12.20) 


U>a 2 — 




&alT 

2 


(12.29) 


since £2 a2 < £2 a2 and tan Q7’/2 is a monotonic increasing function over the range 0 < < a> s /2. 

Let us assume that is chosen such that Eqs. (12.14) and (12.16) are satisfied. If we eliminate a>„ \ 
in Eq. (12.16) using Eq. (12.14) and then eliminate u > a 2 using Eq. (12.20), we get 


co a 


“'ll ~ 
B(b a 2 


(2/r) 2 tan 2 (^ fl2 r/2)- W g 
(25/ T) tan (Q a2 T/2) 


Therefore, from Eqs. (12.29) and (12.30), we have 


(2/r) 2 tan 2 (^ 2 r/2)- W 2 
(25/ T) tan (Cl a2 T/2) 


and on eliminating a>o and 5, we conclude that 


(Op_ 

w p 


> ^2 


where 


K a tan(^ fl2 5/2) 
tan 2 {Cl a2 T/2) - K B 


(12.30) 


(12.31) 


That is, in order to satisfy the required specifications at the upper stopband edge, Q„ 2 , the selectivity 
of the normalized analog LP filter must be equal to or exceed constant K 2 . 

Summarizing, if > Q„| and Q„ 2 is assumed to satisfy the required constraints, then 
(Op/cOa > and if f2„ 2 < & a2 and is assumed to satisfy the required constraints, then 
Wp/Wa > AS. These relations also hold in the reverse order, that is, if co p /a) a > K\ then 
and if a> p /w a > AS then Q a2 < Q fl2 . Therefore, if we ensure that 


— > K where K — maxt K \. AS) 

co a 


then and Q. a2 < Q a2 

as required. In words, in order to satisfy the specifications at the lower stopband edge, we need a 
selectivity of at least K\ for the normalized LP filter and to satisfy the specifications at the upper 
stopband edge, we need a selectivity of at least K 2 . Therefore, choosing the larger value of the 
selectivity would ensure that the specifications are satisfied at both stopband edges. 

The appropriate value for K is easily deduced from Eqs. (12.28) and (12.31) as 

r/fi if Kc ^ Kb 

I K 2 if K c < K b 
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Table 12.3 Bandpass and bandstop filters 


BP 


BS 


where 


2 - sfK^ 


COO = — 

T 


( °r> J 

\K X 

if K c > K b 

0> a \ 

[k 2 

if K c < K b 

2 K a 

B = 

To) p 

_ 2JK~ b 


uyy — 

T 


(Op 

— > < 

' 1 

k 2 

if K c > K b 

CO a 

1 

if K c < K b 


2 K A (o p 
B — - 


K a = tan 
K c — tan 


& P iT & P \T 

— -tan —- 

2 2 

&a I T & a2 T 
-tan- 


K a tan(^ fl2 T/2) 
tan 2 (Q a2 T/2)-K B 


K B = tan 


& P iT 

2 


tan 


& P iT 

2 


K a tan(^ a1 r/2) 

Kb ~ tan 2 (Q fll 7’/2) 


where 


K c = tan 


& a lT 

2 


tan 


&alT 

2 


The same approach can also be applied to deduce appropriate formulas for bandstop filters. The 
required design formulas for BP and BS filters are summarized in Table 12.3. 

The formulas derived so far are very general and apply to any normalized LP filter that has a 
loss characteristic of a form illustrated in Fig. 12.1. Specific formulas for Butterworth, Chebyshev, 
inverse-Chebyshev, and elliptic filters can fairly easily be obtained as will now be demonstrated. 


12.3.3 Butterworth Filters 

The loss in a normalized Butterworth filter is given by 


A n {(o) = 10 log (1 + co 2n ) 



574 DIGITAL SIGNAL PROCESSING 


(see Sec. 10.3) where n is the order of the transfer function. Evaluating A N (co) for u> — to p and co a , 
we get 


A n {co p )= A p = 101og(l+« 2 ") 
Solving for co p and co a , we obtain 

(o p = (10 O M " - l) 1/2n 


and A N (co a ) = A a — 101og(l + co 2 a n ) 

and co a = (10 01A * - 1) 1/2 " (12.32) 


Hence from Eq. (12.32) and Tables 12.2 and 12.3, we have 

ay / IQ^.-i y' 2 - 

at. V 10» M - - 1 ) ~ 

where K depends on the type of filter and is given in terms of constants Kq, K \ , and Ki in Table 12.4. 
Solving for n, we obtain 

> logP 

" ~ 2 log (1/ K) 


where 


10 01A “ - 1 
10 01a p - 1 


(12.33) 


The smallest integer that would satisfy the above equation is the minimum filter order that would 
satisfy the required specifications. 


Table 12.4 Butterworth filters 




RECURSIVE (HR) FILTERS SATISFYING PRESCRIBED SPECIFICATIONS 575 


12.3.4 Chebyshev Filters 

In normalized Chebyshev filters, we have 

An(co) — 10 log [1 + e 2 T^(a>)\ 

where T„(w ) = cosh (n cosh -1 a >) for co p < a> < oo 

with e 2 = io 0,1Ap _ i 

and cop = 1 (12.34) 


(see Sec. 10.4). For co = co a 


An {(a a) — A a = 10 log {1 + (10 p — l)[cosh(« cosh w a )]"} 

(O a — cosh ( — cosh -1 \Td 
V n 


(12.35) 


Thus from Eqs. (12.34) and (12.35) and Tables 12.2 and 12.3, we obtain 


1 


(O a 


cosh cosh 1 *J~D 


> K 


where K is given in terms of constants Kq, K \, and K 2 in Table 12.5. Solving for n, the order of the 
normalized LP filter that would satisfy the specifications must satisfy the inequality 


n > 


cosh 1 \[D 
cosh -1 (l/^f) 


Table 12.5 Chebyshev filters 
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where cosh 1 x can be evaluated using the identity 

cosh -1 .r = In (x + \Jx 2 — 1) 


12.3.5 Inverse-Chebyshev Filters 

In normalized inverse-Chebyshev filters, the loss is given by 

A N (a>) 

where T n (1 /co) 

with S' 2 

and co a 

(see Sec. 10.5). For oo — co p , we can write 


= 10 log 


1 + 


S 2 T 2 (l/ao) 


= cosh [n cosh (1 /co)] for 0 < co < co a 

1 


10 01A ° - 1 


= 1 


(12.36) 


A n (co p ) = 10 log 


& 2 T,H i/M 


Now solving for co p , we obtain 


cosh cosh 1 \[T) 


and from Eqs. (12.36) and (12.37) 


00 r, 


1 


> K 


02(1 cosh cosh 1 VoJ 

Therefore, the order of the normalized LP filter must satisfy the inequality 


(12.37) 


cosh '/D 
cosh 1 (1 / K) 

where K in terms of constants Kq, K \, and Ki is given in Table 12.5. Evidently, the formula for n 
is the same as for Chebyshev filters and thus inverse-Chebyshev filters can be designed in the same 
way as Chebyshev ones using the parameters in Table 12.5 except that the value for co p given by 
Eq. (12.37) should be used instead of unity. 


12.3.6 Elliptic Filters 

In elliptic filters, the selectivity factor is defined as 

OO a 
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Table 12.6 Elliptic filters 


k uj p 

LP 

Kq 

HP 

1 1 

Kq ^K ~ 0 

BP 

K i if K c >K b JK[ 
K 2 if K c < K b 4T 2 

BS 

t ,: 

K, itK ^ K ‘ VT7 


log 16D 10 01A “ - 1 

n > — - D = „ ,,- 

- log (1 /q ) 10 01A * - 1 


(see Sec. 10.6) and from Tables 12.2 and 12.3, we have 

k > K 

where K — Kq, 1/Kq, .... Since any value in the range 0 to 1, except for unity, is a permissible 
value for k, we can assign the lowest acceptable value, namely, 

k = K 

as in Table 12.6, which will lead to the lowest order normalized LP analog filter. 

With k chosen, the value of a> p is also fixed, that is, 

a> p = Vk 

Finally, with k, A p , and A a known the necessary value for n can be computed by using the formula 
in Table 12.6 (see Sec. 10.6.5). 

12.4 DESIGN USING THE FORMULAS 
AND TABLES 

The formulas and tables developed in the preceding section lead to the following simple design 
procedure: 

1. Using the prescribed specifications, determine n and co p , and for elliptic filters also k, from 
Tables 12.4 to 12.6 (use Eq. (12.37) to calculate o> p for inverse-Chebyshev filters). 

2. Determine X for LP and HP filters using Table 12.2 or B and a>o for BP and BS filters using 
Table 12.3. 
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3. Form the normalized transfer function (see Chap. 10). 

4. Apply the analog-filter transformation in Eq. (12.1). 

5. Apply the bilinear transformation in Eq. (12.2). 

The procedure yields LP and HP filters that satisfy the specifications exactly at the passband 
edge and oversatisfy the specifications at the stopband edge. In the case of bandpass and bandstop 
filters, the specifications are satisfied exactly at the two passband edges and are oversatisfied at the 
stopband edges. 


Example 12.1 


Design a highpass filter that would satisfy the following specifications: 
A p — 1 dB A a = 45 dB Cl p = 3.5 rad/s 


Cl a — 1.5 rad/s <o s = 10 rad/s 

Use a Butterworth, a Chebyshev, and then an elliptic approximation. 


■ Solution 

Butterworth filter: The sampling period is 


From Table 12.2 


Hence from Table 12.4 


2tc 2 :r 

a> s 10 


tan(3.57r/10) 

K 0 = - = 3.851840 


tan(1.5jr/10) 


10 4 5 - 1 , 
D = -r = 1.221270 x 10 5 


n > 


10 01 - 1 
logO 
2 log K 0 


4.34 5 


Now from Table 12.2 


(o„ = (10 ai - If 1 = 8.736097 x 10" 


2 Cl T 

X = —(o„ tan —-— = 5.457600 
T p 2 


Chebyshev filter: From Table 12.5 

cosh- 1 ln (^ + VO - 1) 


n > 


cosh 


K 0 ln(V 0 + V K 0 - 1 ) 


3.24 -* 4 


(Op = 1 
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Hence from Table 12.2 


X = 6.247183 


Elliptic filter: From Table 12.6 



1 , 

— = 2.596162 x KT 1 
K 0 


Now, from Eqs. (10.86)-(10.88), we obtain 

k’ = \J\-k 2 = 9.657119 x KT 1 
i (i- VF N 


qo 


2 l i +VF 


= 4.361108 x 10 


i-3 


q = q 0 + 2qQ-\ - ^ q 0 


Hence from Table 12.6 


^ log 16 D 

" ~ log(l7 q) 


2.67 


3 


co p = Vk — 5.095255 x 10" 1 


and from Table 12.2 


X = 3.183099 


At this point the normalized LP Butterworth, Chebyshev, and elliptic approximations 
can be obtained (see Chap. 10). The designs can be completed by applying the LP- 
to-HP transformation and after that the bilinear transformation to each of the three 
approximations. 

The transfer functions Hn(s), Hhp(s), and Hd(z) can be put in the form 

H TT aoj +aijw + a 2 j w 2 
° 7 i b °j + bl J w + fajw 2 

where Hq is a multiplier constant and w — s, ,v, or z. The coefficients of H N (,v) can be 
computed as in Table 12.7, those of //np(.v) as in Table 12.8, and those of Hn(z.) as in 
Table 12.9. 

The loss characteristics of the three filters are plotted in Fig. 12.4. The actual 
minimum stopband loss for the Butterworth, Chebyshev, and elliptic filter are 52.70, 
58.45, and 52.90 dB, respectively. 
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Table 12.7 Coefficients of H N (s) (Example 12.1) 



j a 0j 

a V 

aij 

boj 

bij 

bij 

Butter worth 

1 1 

0 

0 

1 

1.0 

0 


2 1 

0 

0 

1 

1.618034 

1 


3 1 

0 

0 

1 

6.1803407? — 

1 1 


q 

II 

s? 






Chebyshev 

1 1 

0 

0 

2.793981E - 

1 6.7373947? - 

1 1 


2 1 

0 

0 

9.865049 £ - 

1 2.7907207? - 

1 1 


H 0 = 2.456533 E - 

1 




Elliptic 

1 1.0 

0 

0 

2.573050£ - 

1 1.0 

0 


2 5.091668 

0 

1 

2.5923447? - 

1 2.4420487? - 

1 1 


H 0 = 1.310029E - 

2 





Table 12.8 

Coefficients of H hp 

(s) (Example 12.1) 




j 

a 0j 

d\j 

d 2 j 

boj 

by 

by 

Butterworth 

1 

0 

1 

0 

5.457600 

1.0 

0 


2 

0 

0 

1 

2.9785407? + 1 

8.830582 

1 


3 

0 

0 

1 

2.9785407? + 1 

3.372982 

1 


Ho 

= 1.0 






Chebyshev 

1 

0 

0 

1 

1.3968357? + 2 

1.5064437? 4- 1 

1 


2 

0 

0 

1 

3.9561187? + 1 

1.767263 

1 


H 0 

= 8.9125097? - 

-1 




Elliptic 

1 

0.0 

1 

0 

1.23709 IE + 1 

1.0 

0 


2 

1.989941 

0 

1 

3.9084787? + 1 

2.998552 

1 


Ho 

= 1.0 
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Table 12.9 Coefficients of // D (z) (Example 12.1) 



j 

“o i 

«i./ 


"2 1 

boj 

bij 

h v 

Butterworth 

1 

-1 

1 


0 

2.632312E — 1 

1.0 

0 


2 

1 

-2 


1 

1.735936E — 1 

5.778156E — 1 

1 


3 

1 

-2 


1 

5.760838E — 1 

7.759805 £ — 1 

1 


Ho 

= 1.097518E 

-2 





Chebyshev 

1 

1 

-2 


1 

5.150704E — 1 

1.310140 

1 


2 

1 

-2 


1 

7.966193L — 1 

1.063983 

1 


Ho 

= 8.363241E 

- 3 





Elliptic 

1 

-1 

1.0 


0 

5.907039E — 1 

1.0 

0 


2 

1 

-1.343365 

1 

6.751385E — 1 

9.854281E - 1 

1 


Ho 

= 4.221731E 

-2 







Figure 12.4 Loss characteristics of highpass filters (Example 12.1). 
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Example 12.2 


dons: 


Design an elliptic bandpass filter that would satisfy the following specifica- 


A p = 1 dB A a = 45 dB Q pl = 900 rad/s fr p2 =1100 rad/s 
(2 nl = 800 rad/s Ci a2 = 1200 rad/s co s = 6000 rad/s 


■ Solution 

From Table 12.3 


K — tan 


IIOOjt 

6000 


tan 


900tt 


6000 


= 1.398821 x 10“ 


Kg — tan 


900jt IIOOtt 
tan 


K c — tan 


6000 6000 

8007T 12007r 

tan 


= 3.308897 x 10“ 


6000 6000 
Hence Kc < Kb and from Table 12.6, we get 


= 3.234776 x 10“ 


K A ta.n(& a2 T/2) 1J;n „ n ln _, 

k — K 2 = —r ~ -= 5.159570 x 10 

tan 2 (Q. a2 T/2) — K H 


co. 


= yJ~K 2 = 7.183016 x 10 


,-i 


D is the same as in Example 12.1, that is, D — 1.221270 x 10 5 , and from Eqs. (10.86)— 
(10.88), we have 

k! = yjl -k 2 = 8.566144 x 10“' 

i f i- Vic’ 


qo 


Hence 

Now, from Table 12.3 

2 VK^ 


2 \i + VF 
q = qo + 2^0 + • 

log 16D 


n > 


log (1/?) 


a>0 : 


= 1.098609 x 10" 


= 1.933628 x 10" 2 

• • » 1.933629 x 10“ 2 
3.67 -> 4 


2 k 

and B = ^ = 3.719263 x 10 2 


Tco n 


The parameters of the elliptic approximation and the LP-to-BP transformation are, at 
this point, available. Hence the elliptic approximation can be obtained (see Sec. 10.6.6). 
















RECURSIVE (HR) FILTERS SATISFYING PRESCRIBED SPECIFICATIONS 583 


Table 12.10 Coefficients of H D (z ) (Example 12.2) 


j 

a 0j 

«i j 

b 0j 

K 

1 

1.0 

-1.602667 

9.268668 E - 1 

-8.886598E - 1 

2 

1.0 

—7.283103E — 3 

9.306057E - 1 

-1.046605 

3 

1.0 

-1.331115 

9.738539 E - 1 

-8.048914E - 1 

4 

1.0 

—5.885571 Zs — 1 

9.767824E - 1 

-1.160308 

H 0 

= 3.444154E - 3 




Applying the LP-to-BP transformation followed by the bilinear transformation yields 
the transfer function of the required filter as 


4 

Hd(z) = H 0 n 
1=1 


aoj + a\jz + z 2 
b 0j + b\jz + z 2 


The numerical values of the coefficients are given in Table 12.10. The loss characteristic 
of the filter is plotted in Fig. 12.5. The actual minimum stopband loss is 50.64 dB. 



Figure 12.5 Loss characteristic of elliptic bandpass filter (Example 12.2). 
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Example 12.3 


Design a Chebyshev bandstop filter that would satisfy the following specifi¬ 


cations: 

A p = 0.5 dB A a = 40 dB = 350 rad/s & p2 = 700 rad/s 

Sl a \ = 430 rad/s 

■ Solution 

The sampling period is given by 


Hence 


“/?! 1 


i2 = 600 rad/s 

co s = 

2tc 

2tt 


CO s 

~ 3000 


35tt 

CipiT 

70tt 

300 

2 

“ 300 

43t r 

&a2T 

607T 

300 

2 

“ 300 


From Table 12.3, we have 


IQjt 


357T 


Ka — tan-tan-= 5.165400 x 10 

300 300 

357r 70 t r 

K b — tan-tan-= 3.456327 x 10 

300 300 


.-i 


437r 60 tt 

Kq = tan-tan-= 3.512244 x 10 1 

300 300 

Since Kq > K b , according to Table 12.5, we need to compute K = 1 / K 2 , that is, 

1 tan 2 (£2 fl 7772)- K B , 

K = — =- ' - = 4.855769 x 10” 1 

_ - -- 


K a tan(f2 fl2 T/2) 


From Table 12.5, 


10 4 0 - 1 4 
D = -r = 8.194662 x 10 4 


1Q0.05 _ l 

cosh” 1 \ZT) 
cosh” 1 1 /K 


= 4.70 


t o p = 1 


Now from Table 12.3, the parameters of the LP-to-BS transformation can be obtained 
as 

2s/K~b 


(Dq 


= 5.614083 x 10- 


B = 2KaW p = 4.932594 x 10 2 
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Table 12.11 Coefficients of H D (z) (Example 12.3) 


j 

«<>/ 

Cllj 

b 0 j 


by 


1 

1.0 

-9.725792E - 1 

-2.887281E - 

2 

-4.722491 E- 

1 

2 

1.0 

-9.725792E - 1 

6.230100E - 

1 

5.028889 E - 

2 

3 

1.0 

-9.725792E - 1 

7.543570E - 

1 

-1.400163 


4 

1.0 

-9.725792E - 1 

9.168994 £ - 

1 

—2.175109E — 

1 

5 

1.0 

-9.725792E - 1 

9.428927E - 

1 

-1.435926 


H 0 

= 2.225052E - 1 






By obtaining the appropriate Chebyshev approximation (see Sec. 10.4.3) and then ap¬ 
plying the LP-to-BS transformation followed by the bilinear transformation the transfer 
function is of the required digital filter can be obtained as 


5 

H D (Z)= Ho n 
1=1 


a 0j + a\jZ + z 2 
boj + bijz + z 2 


where the coefficients and /; ( / are given in Table 12.11. The loss characteristic of the 
filter is plotted in Fig. 12.6. The actual minimum stopband loss is 43.50 dB. 



Figure 12.6 Loss characteristic of Chebyshev bandstop filter (Example 12.3). 
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12.5 CONSTANT GROUP DELAY 

The phase response in filters designed by using the method described in this chapter is in general 
quite nonlinear because of two reasons. First, the Butterworth, Chebyshev, inverse-Chebyshev, and 
elliptic approximations are inherently nonlinear-phase approximations. Second, the warping effect 
tends to increase the nonlinearity of the phase response. As a consequence, the group delay tends 
to vary with frequency and the application of these filters tends to introduce delay distortion (see 
Sec. 5.7). 

Constant group-delay filters can sometimes be designed by using constant-delay approxima¬ 
tions such as the Bessel-Thomson approximation with design methods that preserve the linearity 
in the phase response of the analog filter, e.g., the invariant impulse-response method. However, 
a constant delay and prescribed loss specifications are usually difficult to achieve simultaneously, 
particularly if bandpass or bandstop high-selectivity filters are desired. 

12.5.1 Delay Equalization 

The design of constant-delay analog filters satisfying prescribed loss specifications is almost invari¬ 
ably accomplished in two steps. First a filter is designed satisfying the loss specifications ignoring 
the group delay. Then a delay equalizer is designed which can be used in cascade with the filter to 
compensate for variations in the group delay of the filter. The same technique can also be used in 
digital filters. 

Let Hp{z) and H E (z) be the transfer functions of the filter and equalizer, respectively. The 
group delays of the filter and equalizer are given by 


r f(co) = 


(10 f (oj) 

da> 


and 


r E (co) = 


de E (ar) 

dco 


respectively, where 


d F (co) = arg H F (e ja>T ) and 0 E {co) = arg H E (e ’ mT ) 

The overall transfer function of the filter-equalizer combination is 

H fe (z) = H f (z)H e (z) 

Hence \H FE (e jo>T )\ = \H F (e jcoT )\\H E (e iaT )\ 

and 0 FE (o>) = 0 F (cd)0 E {cd) (12.38) 

Now from Eq. (12.38), the overall group delay of the filter-equalizer combination can be obtained as 


Xfe((o) = Tf(( 0) + x E (u>) 
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Therefore, a digital filter that satisfies prescribed loss specifications and has constant group delay 
with respect to some passband co p \ < co < co p 2 can be designed using the following steps: 

1. Design a filter satisfying the loss specifications using the procedure in Sec. 12.4. 

2. Design an equalizer with 


and 


\H E (e j ‘ oT )\ = 1 for 0 < co < co s /2 

t e{u>) = r — r F (co) for co p \ < co < co p 2 


(12.39) 


where r is a constant. 


From step 2, H E (z) must be an allpass transfer function of the form 


H e (z) = 


M 


n 


1 + C\jZ + C0jZ 2 
COj + CijZ + z 2 


(12.40) 


The equalizer can be designed by finding a set of values for c'o /, c\j, r, and M such that (a) Eq. (12.39) 
is satisfied to within a prescribed error in order to achieve approximately constant group delay with 
respect to the passband, and ( b ) the poles of H E (z) are inside the unit circle of the z plane to ensure 
that the equalizer is stable. Equalizers can be designed by using optimization methods as will be 
demonstrated in Sec. 16.8. 

Note that delay equalization is unnecessary for stopbands since signals that pass through 
stopbands are normally deemed to be noise and delay distortion in noise is of no concert. 


12.5.2 Zero-Phase Filters 

In nonreal-time applications, the problem of delay distortion can be eliminated in a fairly simple man¬ 
ner by designing the filter as a cascade arrangement of two filters characterized by H(z) and H(z~ l ), 
as depicted in Fig. 12.7a. Since H(e~' ia>T ) is the complex conjugate of ll(e Jml ), the frequency 
response of the cascade arrangement can be expressed as 

H 0 (e ja,T ) = H(e i0>T )H(e- jwT ) = \H(e jloT )\ 2 



(a) 



(b) 


Figure 12.7 ( a ) Zero-phase filter, ( b ) implementation. 
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In other words, the frequency response of the arrangement is real and, as a result, the filter has 
zero phase response and, therefore, it would introduce zero delay. If a filter with passband ripple 
A p and minimum stopband loss A a is required, the design can be readily completed by obtaining a 
transfer function with passband ripple A p /2 and minimum stopband loss A a /2, since the two filters 
in Fig. \2.1a have identical amplitude responses. 

If the impulse response of the first filter is h(nT), then that of the second filter is h(—n T ), as can 
be readily demonstrated (see Prob. 12.20), and if the first filter is causal, the second one is noncausal. 
Hence the cascade of Fig. 12.7a can be implemented, as depicted in Fig. 12.1b, where devices R are 
used to reverse the signals at the input and output of the second filter. In this arrangement, the first 
filter introduces a certain delay, which depends on the frequency, and thus a certain amount of delay 
distortion is introduced. The second filter introduces exactly the same delay as the first, but, since 
the signal is fed backward, the delay is actually a time advance and, therefore, cancels the delay of 
the first filter. 

The scheme of Fig. 12.7 is suitable for nonreal-time applications since it uses a noncausal 
filter. An alternative approach for the design of constant-delay filters that can be used for nonreal- or 
real-time applications is to use nonrecursive approximations which are explored in Chaps. 9 and 15. 


12.6 AMPLITUDE EQUALIZATION 

In many applications, a filter is required to operate in cascade with a channel or system that does 
not have a constant amplitude response (e.g., a D/A converter. Fig. 6Aid). If the transfer function 
of such a channel is Hc(z ) and the passband of the channel-filter combination extends from a > p i to 
co P 2 , then the transfer function of the filter must be chosen such that 

\H c (e ja>T )H F (e ja,T )\ = 1 for co pl < co < a> p2 

to within a prescribed tolerance in order to keep the amplitude distortion to an acceptable level (see 
Sec. 5.7). If the variation in the amplitude response of the channel is small, it may be possible to solve 
the problem by taking the channel loss into account when the filter specifications are formulated. 
Alternatively, if the variation of the amplitude response of the channel is large, then the filter may 
have to be tuned or redesigned using one of the optimization methods described in Chap. 16 (e.g., 
see Example 16.3). 


REFERENCES 

[1 ] A. Antoniou, “Design of elliptic digital filters: Prescribed specifications,” Proc. Inst. Elect. 
Eng., Part G, vol. 124, pp. 341-344, Apr. 1977 (see vol. 125, p. 504, June 1978 for errata). 

PROBLEMS 


12.1. Design a lowpass digital filter that would satisfy the specifications of Fig. P12.1. Use a Butterworth 
approximation. 
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Figure P12.1 


12.2. Redesign the filter of Prob. 12.1 using a Chebyshev approximation. 

12.3. Redesign the filter of Prob. 12.1 using an inverse-Chebyshev approximation. 

12.4. Redesign the filter of Prob. 12.1 using an elliptic approximation. 

12.5. Design a highpass digital filter that would satisfy the specifications of Fig. P12.5. Use a Butterworth 
approximation. 

12.6. Redesign the filter of Prob. 12.5 using a Chebyshev approximation. 

12.7. Redesign the filter of Prob. 12.5 using an inverse-Chebyshev approximation. 

12.8. Redesign the filter of Prob. 12.5 using an elliptic approximation. 

12.9. Design a bandpass digital filter that would satisfy the specifications of Fig. P12.9. Use a Butterworth 
approximation. 

12.10. Redesign the filter of Prob. 12.9 using a Chebyshev approximation. 

12.11. Redesign the filter of Prob. 12.9 using an inverse-Chebyshev approximation. 

12.12. Redesign the filter of Prob. 12.9 using an elliptic approximation. 

12.13. Design a bandstop digital filter that would satisfy the specifications of Fig. P12.13. Use a Butterworth 
approximation. 

12.14. Redesign the filter of Prob. 12.13 using a Chebyshev approximation. 

12.15. Redesign the filter of Prob. 12.13 using an inverse-Chebyshev approximation. 

12.16. Redesign the filter of Prob. 12.13 using an elliptic approximation. 
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Figure P12.9 
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12.17. Derive the formulas of Table 12.2 for highpass filters. 

12.18. Derive the formulas of Table 12.3 for bandstop filters. 

12.19. Shaw that the transfer function of Eq. (12.40) is an allpass transfer function. 

12.20. A digital filter with an impulse response h(nT) has a transfer function H(z). Show that a filter with a 
transfer function H(z~ l ) has an impulse response h(—nT). 
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CHAPTER 

13 


RANDOM 

SIGNALS 


13.1 INTRODUCTION 

The methods of analysis considered so far assume deterministic signals. Frequently in digital filters 
and communication systems in general random signals are encountered, e.g., the noise generated 
by an analog-to-digital (A/D) converter or the noise generated by an amplifier. Signals of this type 
can assume an infinite number of waveforms, and measurement will at best yield a set of typical 
waveforms. Despite the lack of a complete description, many statistical attributes of a random signal 
can be determined from a statistical description of the signal. 

The time- and frequency-domain statistical attributes of random signals as well as the effect 
of filtering on such signals can be studied by using the concept of a random process. 

This chapter provides a brief description of random processes. The main results are presented 
in terms of continuous-time random signals and are then extended to discrete-time signals by using 
the interrelation between the Fourier and z transforms. The chapter begins with a brief summary of 
the essential features of random variables. Detailed discussions of random variables and processes 
can be found in [ 1-5]. 

13.2 RANDOM VARIABLES 

Consider an experiment which may have a finite or infinite number of random outcomes, and let ij, 
£>, ■ • ■ be the possible outcomes. A set S comprising all the possible £ can be constructed, and a 
number x(£ ) can be assigned to each ( according to some rule. The function x(£), or simply x, whose 
domain is set S and whose range is a set of numbers is called a random variable. Typical random 
variables are the coordinates of the hit position in an experiment of target practice or the speed and 
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direction of the wind at some specified instant in a given region or at some specified location over 
a period of time. Specific random variables that will be studied in some detail in Chap. 14 are the 
errors introduced by the quantization of signals and filter coefficients. 

13.2.1 Probability-Distribution Function 

A random variable x may assume values in a certain range (x \, x 2 ), where x\ can be as low as —oo 
and X 2 as high as +oo. The probability of observing random variable x below or at value x is referred 
to as the probability-distribution function of x and is denoted as 

P x (x) — Pr [x < x] 


13.2.2 Probability-Density Function 


The derivative of l\(x) with respect to x is called the probability-density function of x and is denoted 
as 


Px(x) = 


dPy(x) 

dx 


A fundamental property of p K (x) is 

/ OO 

p x (x) dx — 1 

-OO 

since the range (—oo, +oo) must necessarily include the value of x. Also 


PxtXl < x < X 2 \ - 

13.2.3 Uniform Probability Density 


Px(x) dx 


In many situations there is no preferred value or range for the random variable. In such a case, the 
probability density is said to be uniform and is given by 


1 


Px(x) = { X 2 - X\ 
0 


13.2.4 Gaussian Probability Density 


for X\ < x < x 2 
otherwise 


Very common in nature is the Gaussian probability density given by 

Px(x) — — \=e ~ ( - x ~ r,)1 /2<t2 for —oo < x < oo 

try 2 tt 


(13.1) 


The parameters o and r] are constants. 

There are many other important probability-density functions, e.g., binomial , Poisson , and 
Rayleigh [1], but these are beyond the scope of this book. 


13.2.5 Joint Distributions 

An experiment may have two sets of random outcomes, say, £ x i, t ; x2 ,... and t; y i, ^ y2 ,.... For 
example, in an experiment of target practice, the hit position can be described in terms of two 
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coordinates. Experiments of this type necessitate two random variables, say, x and y. The probability 
of observing x and y below or at x and y, respectively, is said to be the joint distribution function of 
x and y and is denoted as 


Pxy(x, y) = Pr [x < X, y < y] 

The joint probability-density function of x and y is defined as 

d 2 P xy (x, y) 


Pxy(x, y) = 


dxdy 


The range (— 00 , 00 ) must include the values of x and y, and hence 

/ oo poo 

/ p xy (x, y)dx dy — 1 

-00 J —OO 

The probability of observing x and y in the ranges X\ < x < xi and yi < y < yi, respectively, is 
given by 


ryi rx 2 

Pr [xi < x < x 2 , yi < y < y 2 ] = / / fh y (x, y) dx dy 

J yi Jx 1 

Two random variables x and y representing outcomes £ x \, f x 2 ,... and <j v 1 , fa, ■ ■ • of an exper¬ 
iment are said to be statistically independent if the occurrence of any outcome £ x does not influence 
the occurrence of any outcome f. and vice versa. A necessary and sufficient condition for statistical 
independence is 


Pxy(x, y) = Px(x)p y (y) 


(13.2) 


13.2.6 Mean Values and Moments 

The mean or expected value of random variable x is defined as 

/ OO 

xpx(x) dx 

-OO 

Similarly, if a random variable z is a function of two other random variables x and y, that is, 

z = f(x, y) 


then 


E{ z} = 


zpz(z) dz 


(13.3) 


If z is a single-valued function of x and y and x < x < x +dx, y < y < y + dy, then z < z < z + dz. 
Hence 


Pr lz < z < z + dz] = Pr [x < x < x + dx, y < y < y + rfy] 
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or 


p z (z)dz = p X y(x , y)dxdy 


poo poo 


and from Eq. (13.3) 

£{z} = / / f(x,y)p %y (x,y)dxdy 

.7—00 .7—00 

Actually this is a general relation that holds for multivalued functions as well [1]. For 

z = xy 

we have 

/ oo /»oo 

/ xyp X y(x, y)dx dy 
-oo J —oo 

and if variables x and y are statistically independent, then the use of Eq. (13.2) yields 

/ OO POO 

xp x (x)dx / ypy(y) dy = E{x}E[y) 

-oo J —oo 

The nth moment of x is defined as 

/ OO 

x n px(x)dx 

-OO 

The second moment is usually referred to as the mean square of x. 

The nth central moment of x is defined as 


E{(x- E{x)f\ = / (x- E{x}) n p x (x)dx 

.7 —OO 

The second central moment is commonly referred to as the variance and is given by 

cr x 2 = £{(x - £{x}) 2 } 

= £{x 2 - 2x£{x} + (£{x}) 2 } 

= £{x 2 } - (£{x}) 2 

if 

Z = Ct\X\ -(- U 2 X 2 


(13.4) 


(13.5) 


(13.6) 


where a\, a 2 are constants and xi, X 2 are statistically independent random variables, then from 
Eqs. (13.4) and (13.5), we have 
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In general, if 


n 

Z = fl/X/ 
;=i 


and variables x 1; X 2 ,..., x„ are statistically independent, then 


2 \ ' 2 2 

= 2^ a i G x, 
1 = 1 


(13.7) 


Example 13.1 


density given by 


(a) Find the mean and variance for a random variable with a uniform probability 


1 


Px(x) = { X 2 - X\ 
0 


for x\ < x < x 2 

otherwise 


(, b ) Repeat part (a) for a random variable with a Gaussian probability density 

1 


Px(x) = — 

0\/2 TT 


-(■ x-ilf/2cr 2 


for —OO < A < OO 


■ Solution 


(a) From the definition of the mean, we have 


f Xl x 1 

£{x} = / - dx = -(xi+x 2 ) ■ 

Jxi x 2 X\ 2 

(13.8) 

Similarly, the mean square can be deduced as 


pX2 r 2 r 3 r 3 

E{x 2 } = * dx= 2 1 

Jxi X 2 -X\ 3(x 2 X! ) 

(13.9) 

and from Eq. (13.6), we obtain 


2 (x 2 Xl) 2 

a " = - ■ 

x 12 

(13.10) 

( b ) In this case, we can write 


i r°° 

£{x} = dx 

G^Jln J —oo 
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and with x = y + r/ 


£{x} = —( f ye~y 2/2a2 dy + r, I e~y 2/2 ° 2 dy ) 

G v Z7T \J—oo ./—oo / 

The first integral is zero because the integrand is an odd function of y whereas the second 
integral is equal to a-Jin according to standard tables of integrals. Hence 

£{x} = rj m 

Now 

1 r°° 

£{x 2 } = —= / xV (jc -" )2/2ff2 dx 

Gy/^JT J —oo 


and, as before, 


£{x 2 } — a 2 + if or a 2 — a 2 m 


13.3 RANDOM PROCESSES 

A random process is an extension of the concept of a random variable. Consider an experiment with 
possible random outcomes £i, £ 2 , • ■ • ■ A set S comprising all ( can be constructed and a waveform 
x(r, £) can be assigned to each £ according to some rule. The set of waveforms obtained is called an 
ensemble , and each individual waveform is said to be a sample function. Set S, the ensemble, and 
the probability description associated with S constitute a random process. 

The concept of a random process can be illustrated by an example. Suppose that a large number 
of radio receivers of a particular model are receiving a carrier signal transmitted by a broadcasting 
station. With the receivers located at different distances from the broadcasting station, the amplitude 
and phase of the received carrier will be different at each receiver. As a result, the set of the received 
waveforms, illustrated in Fig. 13.1, can be described by 

x(t, i;) = zcos(ft> c f + y) 

where z and y are random variables and f = fi, £ 2 ,_The set of all possible waveforms that might 

be received constitutes an ensemble and the ensemble together with the probability densities of z 
and y constitutes a random process. 

13.3.1 Notation 

A random process can be represented by x(t, t;) or in a simplified notation by x(r). Depending on 
the circumstances, x(f, () can represent one of four things as follows: 

1. The ensemble , if t and £ are variables. 

2. A sample function, if t is variable and ( is fixed. 
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Figure 13.1 A random process. 


3. A random variable, if t is fixed and £ is variable. 

4. A single number, if t and £ are fixed. 


13.4 FIRST- AND SECOND-ORDER STATISTICS 

For a fixed value of t, x(r) is a random variable representing the instantaneous values of the various 
sample functions over the ensemble. The probability distribution and probability density of x(r) are 
denoted as 


P(x; t) = Pr [x(f) < x] 


dP(x;t) 

and p(x;t ) =- 

dx 


respectively. These two equations constitute th e first-order statistics of the random process. 
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At any two instants t\ and t 2 ■ x( 4 ) and x(f 2 ) are distinct random variables. Their joint probability 
distribution and joint probability density depend on t\ and r 2 in general, and are denoted as 

P(x i, x 2 ; t \, t 2 ) = Pr [x(fO < x \, x(r 2 ) < x 2 \ 


and 


p(x u x 2 ;t u t 2 ) 


d 1 2 P(xi, x 2 \t\, t 2 ) 
dx\dx 2 


respectively. These two equations constitute the second-order statistics of the random process. 

Similarly, at any k instants t\, t 2 ,, t, t, the quantities xi, x 2 ,..., and x* are distinct random 
variables. Their joint probability distribution and joint probability density depend on t \, t 2 , ..., 4 and 
can be defined as before. These quantities constitute the kth-order statistics of the random process. 


Example 13.2 


Find the first-order probability density p(x; t ) for random process 


x(0 = yt-2 


where y is a random variable with a probability density 


Py(y) = 


1 c -y 2 /i 


for —00 < y < 00 


■ Solution 


If x and y are possible values of x(f) and y, then 


1 

x — yt — 2 or y = -(x + 2) 


From Fig. 13.2 


Pr [x < x < x + \dx\\ = Pr [y < y < y + \dy\\ 


i.e., 


p x (x)\dx\ = p y (y)\dy\ or 


Px(x) = 


Py(y) 

\dx/dy\ 


Since 

dx 

Ty= ( 

we obtain 


p(x\t) = p x (x) = 


1 c -(x+2) 2 /2d 

\t\s/2n 


for —00 < x < 00 m 
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Figure 13.2 Function x = yt — 2 (Example 13.2). 


Example 13.3 


Find the first-order probability density p(x; t ) of the random process 
x(0 = cos (a) c t + y) 


where y is a random variable with probability density 

. for 0 < y < 2 tt 

Py(y) = {2 tt 

0 otherwise 


■ Solution 

If x and y are possible values of x(f) and y, then 


x — cos (co c t + y) 

and from Fig. 13 . 3 , we get 



Figure 13.3 Function x = cos ( a) c t + y ) (Example 13.3). 
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Pr [x < x < x + \dx\] = 

or 

p x (x)|<2x| = 

Hence 

Px(x) = 

where 

x'(y) = 

Since 



+Pr [yi < y < yi + \dy 2 1] 


Py(yi) Py(j2) 

|x'(ji)l \x'(j2)\ 

dx 

— = — sin ( w c t + 
dy 


Py<Ji) = Pyiyi) = Py(y ) and |x'(yi)| = |x'(y 2 )l = |x'(y)| 


we obtain 


[ 7= , fork| < 1 

p(x;0 = p*( 0= i "VI -x 2 

I 0 otherwise 


13.5 MOMENTS AND AUTOCORRELATION 


The first-order statistics give the mean, mean square, and other moments of a random process at any 
instant t. From Sec. 13 . 2.6 


£{x(f)} = 


xp(x \ t)dx 


£{x“(f)} = / x~ p(x',t)dx 


The second-order statistics give the autocorrelation function of a random process, which is 
defined as 


r x (h, t 2 ) = £{x0i)x(f 2 )} = 


x\x 2 p{x\, x 2 \t\, t 2 )dx\ dx 2 


The autocorrelation is a measure of the interdependence between the instantaneous signal values at 
t = t\ and those at t = t 2 . This is the most important attribute of a random process, as it leads to a 
frequency-domain description of the process. 
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Example 13.4 


(a) Find the mean, mean square, and autocorrelation for the random process 
in Example 13.2. ( b ) Repeat part (a) for the process of Example 13.3. 


■ Solution 


(a) The probability density of x(f) has been obtained in Example 13.2 as 
p(x\t) = p x (x) = - [^_ e -( x + 2 f/ 2 t 2 f or _ oc < x < oo 

\t\x/2jt 

Now the mean and mean square of a random variable x with a Gaussian probability 
density 

p x (x) = —f or _ oc < x < oo 

have been obtained in Example 13.1 as 

£{x} = ri and £{x 2 } = a 2 + if 

respectively. Thus, by comparison, the mean and mean square of x(f) can be readily 
obtained as 

£{x(0) = -2 and £{x 2 (t)} = t 2 + 4 m 

The autocorrelation is given by 

r x (ti, h) = E{(yti - 2)(y t 2 - 2)} = ht 2 E{y 2 } - 2(r, + t 2 )E{ y} + 4 


and since y is a random variable with a probability density 

1 


p y (y) ■ 


x/2n 


~y 2 / 2 for 


-oo < y < oo 


(see Example 13.2), we have 

E{ y} = 0 and £{y 2 } = 1 


and 


r x {t\, t 2 ) = ht 2 + 4 


(. b ) The probability density of x(f ) was obtained in Example 13.3 as 

( 1 for \x\ < 1 

0 otherwise 


p( X -t) = Px (t)= { Vl-I 2 
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Thus the mean and mean square of x(f) can be readily obtained as 

1 /■' r 


£{x«} = 


E{x\t)} = - 


n J -1 Vl — x- 

1 f 1 x 2 


dx = 0 


_ dx = i 
2 2 


(13.11) 


7T J _ j yi — X 
The autocorrelation can be expressed as 

r*(t \, t 2 ) = E {cos (o) c t\ + y) cos (a> c t 2 + y)} 

= \ cos (co c ti - a> c t 2 ) + i£{cos {oo c h + co c t 2 + 2 y)} 


Now 


x(f) = cos (co c h + co c t 2 + 2 y) 

is a random variable of the same type as x(f) in Example 13.3, whose probability density 
can be obtained as 


p(x;t) = Px(t) 



i 

— x 2 

0 


for |x| < 1 
otherwise 


(see Example 13.3), and hence Exit) = 0. Therefore, 

h) = \ coscut-r where r = t\ — t 2 m (13.12) 


13.6 STATIONARY PROCESSES 

A random process is said to be strictly stationary if x(r) and x(r + T) have the same statistics (all 
orders) for any value of T. If the mean of x(t) is constant and its autocorrelation depends only on 
t 2 — t \, that is, 


£'{x(t)} = constant £{x(ti)x(f 2 )} = r x (t 2 — ?i) 

the process is called wide-sense stationary. A strictly stationary process is also stationary in the 
wide sense; however, the converse is not necessarily true. The process of Example 13.4, part (a), is 
wide-sense stationary; however, that of Example 13.4, part ( b ), is not stationary. 


13.7 FREQUENCY-DOMAIN REPRESENTATION 

The frequency-domain representation of deterministic signals is normally in terms of amplitude, 
phase, and energy-density spectrums (see Chap. 2). Although such representations are possible for 
random processes [ 1 ], they are avoided in practice because of the mathematical difficulties associated 
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with infinite-energy signals (see Sec. 6.2). Usually, random processes are represented in terms of 
power-density spectra. 

Consider a signal x(t) and let 


xr 0 (t) = 


x(t) for |t| < T 0 


0 


otherwise 


The average power of x(t ) over the interval [— 7o, 7 q] is 


i r T ° i r°° 

PT ‘ = 2Tj-r/ md,= 2ToL o 4 ' 0 "' 

and by virtue of Parseval’s formula (see Theorem 2.16) 

\Xt 0 (Jg>)\ 2 dm 


Pt 0 = 


2Tq 2 n 


where 


XT„(joj) = Tx To (t) 


Evidently, the elemental area in the above integral, namely. 


\X To Um)\ 2 dm 
27o 27T 


IXtoUw)^ 

27b 


df 


represents average power (/ is the frequency in hertz). Therefore, the quantity 

I^CroO'ftOI 2 

27b 

represents the average power per unit bandwidth (in hertz) and can be referred to as the power 
spectral density (PSD) of x To (t). If x To (t) and x(t) are sample functions of random processes x To (t) 
and x(r), respectively, we can define 


PSD of x To (t) 


f \X To (jm)\ 2 \ 

l 27 b J 


and since x To (t) —>■ x(t) as Tq -* oo, we obtain 


PSD of x(t) = S x (m) = lim E 

To-+oo 


\X To (ju)\ 2 ] 
27b J 


(13.13) 


The function S x (m) is said to be the power-density spectrum of the process 
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For stationary processes, the PSD is the Fourier transform of the autocorrelation function, as 
we shall now demonstrate. From Eq. (13.13) 

r X To {jw)X%(j (a ) \ 


lim 

E \ 

r 0 ->oo 

l 


1 

lim 


To-*- OO 

27b 


1 

lim 


To-* OO 

27b 


27b 

rTn 


1 


x(t 2 )e ■ / "' 2 dt 2 / x{t\)e ]0>h dt\ 

-T 0 J-To 


' / [ E{x(t\)x{t 2 )}e Jwih h) dt x dt 2 

7o 


For a wide-sense-stationary process, we have 

£ , {x(f 1 )x(f 2 )} = r x (t 2 - h) 


and hence we can write 


Y rTo pTq 

S x (co)= lim — / / f(t 2 -t x )dtidt 2 (13.14) 

Tq—>oo 11 o ,7_ ro ,7_ ro 


where 


m - h) = r x (t 2 - (13.15) 

The preceding double integral represents the volume under the surface y = f(t 2 — t\ ) and above 
the square region in Fig. 13.4. Since f(t 2 — t\) is constant on any line of the form 

t 2 — t\ + c 


the volume over the elemental area bounded by the square region and the lines 

t 2 = t\ + x and t 2 — t\ + r + dr 

is approximately constant. From the geometry of Fig. 13.4, we note that the elemental area dA is the 
difference between the areas of two overlapping equilateral right-angled triangles. For r > 0, the 
sides of the larger and smaller triangles are 27b ~ r an d 27b — (r + dr), respectively, and hence 

dA = * (27b - t ) 2 - * [27b - (r + ^r )] 2 

1 9 

= (27b — t)dx + -(<7t) 2 
~ (27o — x)dx 

Similarly, for r < 0, we get 


dA (27b + x)dx 
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Figure 13.4 Domain of y = f(t 2 — t\). 


and in general, as d r —> 0, we can write 

dA = (27q — \r\)dr 


Hence the elemental volume for t 2 — t\ = r is 

dV = f(r)(2To — |r|)rfr 

In order to obtain the entire volume under the surface y = /(?2 — t\) and above the square region in 
Fig. 13.4, r must be increased from —2T 0 to +27^; thus Eq. (13.14) can be expressed as 

S x (co)= lim -L [ ° f(r)(2T 0 - \r\)dr 

Tq—>oo 11 o J—2T 0 

Therefore, from Eq. (13.15) 

/ OO 

r x (.r)e- j<OT dr (13.16) 

-OO 
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and if 


we can write 


|r x (r)| dr < oo 


r x (r) = E{x(t)x(t + r)} = I S x (m)e JWT dm 

J — OO 


(13.17) 


i.e., 


r x (r) ** S x (w) 


by virtue of the convergence theorem of the Fourier transform (Theorem 2.5). The formula in 
Eq. (13.16) is known as the Wiener-Khinchine relation. 


Example 13.5 


Find the PSD of the process in Example 13.3. 


■ Solution 

The autocorrelation of the process was obtained in Example 13.4, part ( b ), as 

r(r) = i cos a> c r 

(see Eq. (13.12)). Hence from Eq. (13.16) and Table 6.2 

S x (ft>) = Tr{ r) = y [<5(® + co c ) + S(io - <w c )] ■ 


The autocorrelation is an even function of r, that is, 

rx(r) = r x (—r) 

as can be easily shown, and S x (a>) is an even function of a> by definition. Equations (13.16) and 
(13.17) can thus be written as 


S x (co) = / r x (r)cos(a>r)dr 


1 

r x ( r) =— / S x (co) cos(<ur) dco 

2?r j —oo 


i.e., S x (co) is real. If co = 0, then 


Sx{0) = / r x (r)dr 
J — OO 






RANDOM SIGNALS 609 


i.e., the total area under the autocorrelation function equals the PSD at zero frequency. The average 
power of x(f) is given by 


Average power = Z?{x 2 (f)} = r x (0) = 



dco 
2 :r 


as is to be expected. 

A random process whose PSD is constant at all frequencies is said to be a white-noise process. 

If 


S x (cv) = K 


we have 


>\(t) = KS(t) 

i.e., the autocorrelation of a white-noise process is an impulse at the origin. 


13.8 DISCRETE-TIME RANDOM PROCESSES 

The concept of a random process can be readily extended to discrete-time random signals by simply 
assigning discrete-time waveforms to the possible outcomes of an experiment. The mean, mean 
square, and autocorrelation of a discrete-time process x(nT) can be expressed as 


E{x(nT)} 

E{x\nT)} 

r x (kT) 


xp(x\nT) dx 

) 

x 2 p(x;nT) dx 


J —oo 

E{x(nT)x(nT + kT)} 


A frequency-domain representation for a discrete-time process can be deduced by using the 
interrelations between the z transform and the Fourier transform (see Sec. 6.5.1). We can write 

OO 

Zr x (kT) = Y r(kT)z~ k = R x (z) 

k=—o o 


and from Eq. (6.43c) 

OO 

P x (e 1<oT ) = Y r (.kT)e~ 10)k = Tf x { r) = S x (co) 

k——oo 


(13.18) 
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where 


r x (r) = E{x(t)x(t + r)} 

OO 

x(t) = x(nT)S(t — nT) 

n=—o o 

r = kT 


(see Sec. 6.5). Therefore, from Eqs. (13.13) and (13.18) 


R x (e j<oT ) = lim E 

To—too 


l*r„(»l 2 \ 
2 To J 


and 


X To (j(ti) = Tx To (t) 


and 

„ r . fx(0 for|?|<r 0 

T ° 10 otherwise 

In effect, the z transform of the autocorrelation of discrete-time process x(n T) evaluated on the unit 
circle |z| = 1 is numerically equal to the PSD of the impulse-modulated process x(t). This quantity 
can be referred to as the PSD of discrete-time process x(nT ) and can be represented by S x ie J "‘ T ) by 
analogy with the PSD of continuous-time process x(t) which is represented by S x (co). Consequently, 
we can write 


Zr x {kT) = S x (z) 


where 


rJkT) = ' <( S x (z)z k -' dz (13.19a) 

2t tj J r 

by virtue of Eq. (3.6). If x(t) were a voltage or current waveform, then E\x 2 (t)} would represent the 
average energy that would be delivered in a l-f2 resistor. Consequently, the quantity E{x 2 (nT)} is 
said to be the power in x(nT). It can be obtained by evaluating the autocorrelation function at k — 0, 
that is, 


E{x\nT)} = r x (0) = -h <f S x (z)z~ l dz (13.19b) 

2 ttj J r 

13.9 FILTERING OF DISCRETE-TIME RANDOM SIGNALS 

If a discrete-time random signal is processed by a digital filter, we expect the PSD of the output 
signal to be related to that of the input signal. This indeed is the case, as will now be shown. 
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Consider a filter characterized by H(z), and let x(n ) and \(n ) be the input and output processes, 
respectively. From the convolution summation (see Eq. (4.36b)) 

OO OO 

y(0 = X h(p)x(i - p ) y(j) = ^2 h(q)x(j - q ) 

p——oo q =—oo 

and hence 

{ OO OO 

X X btpMyW ~ f) x (j - q) 

q=—o o p——oo 

With j = i + k and q = p + n, we have 

OO OO 

r y (k) = ^2 *22 h(p)h(p + n)E{x(i — p)x(i — p + k — n)} 

ti ——oo p——oo 
oo 

or fy(fc) = X S(n)r x (k - n) 

n=—o o 


where 


OO 

g(n) = X Kp)h(p + n) 


p——oo 

The use of the real-convolution theorem of the z transform (Theorem 3.7) gives 


Sy(z) = Zr y (k) = Zg(k)Zr x (k ) = G(z)S x (z) (13.20) 


Now 


OO OO OO 

G(z) = Z X h ip)h(p + n) = X X h (P^ h (P + 

p=—oo II ——OO P——OQ 


and with n = k — p 

OO OO 

G(z) = ]T A(*)z-* X = H(z)H(z~ 1 ) (13.21) 

k——oo p=—o o 

Therefore, from Eqs. (13.20) and (13.21) we get 

Sy(z) = tf(z)tf(z _1 )S x (z) (13.22) 

or S y (e'' u7 ’) = |//(e 7 “ 7 ')| 2 S x (e 7W ) 

i.e., the PSZ) of the output process is equal to the squared amplitude response of the filter times the 
PSD of the input process. 
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The output of a digital filter is given by 


y(n) = x(n) + 0.8 y(n — 1) 


The input of the filter is a random signal with zero mean and variance er 2 ; successive values 
of x(n) are statistically independent, (a) Find the output PSD. (b) Obtain an expression for the 
average output power. 

■ Solution 

(a) The autocorrelation of the input signal is 


r x (k) = E{x(n)x(n + k)} 


For k — 0 


r x (k) = E[x 2 (n)} = cr x 2 


For k ^ 0, the use of Eq. (13.4) gives 


r x (k) = E{x(n)}E{x(n + £)} = 0 


Hence 


r x (k) = (T x S(k) and S x (z) = cr 2 


Now from Eq. (13.22) 


S y (z) = cT 2 H(z)H(z- ] ) m 


where 



(b) Front Eq. (13.19b) 



and if F is taken to be the unit circle |z| = 1 we can let z = e ' mT , in which case 


Output power = o 2 EI(e^ a>T )EI(e 7wT )dco m 



1 rm s 


A simple numerical method for the evaluation of the output power can be found in Ref. [6]. 
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PROBLEMS 

13.1. A random variable x has a probability-density function 

J Ke~ x for 1 < x < oo 
M x > = | 0 otherwise 

(a) Find AT. 

( b ) Find Pr [0 < x < 2]. 

13.2. A random variable x has a probability-density function 

! - for 0 < x < q 

1 

0 otherwise 

Find its mean, mean square, and variance. 

Find the mean, mean square, and variance for the random variable of Prob. 13.1. 

Demonstrate the validity of Eq. (13.7). 

A Gaussian random variable x has a mean r] and a variance a 2 . Show that 

Px(x i - )?) = 1 - P X (V - Xl ) 

where P x (x) is the probability-distribution function of a Gaussian random variable with zero mean. 
13.6. A Gaussian random variable x has 17 = 0 and cr = 2. 

(a) Find Pr [x > 2], 

(b) Find Pr [|x| > 2], 

(c) Findxi if Pr [|x| < x t ] = 0.95. 

13.7. The random variable of Prob. 13.5 satisfies the relations 

Pr[x <60] = 0.2 Pr [x > 90] = 0.1 


13.3. 

13.4. 

13.5. 


Find ij and a 2 . 
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13.8. A random variable x has a Rayleigh probability-density function given by 


Px{x) = 


Xe -x 2 / 2a 2 

a 2 

0 


for 0 < x < oo 
otherwise 


Show that 

(a) £{xj = cr 

(b) E{x 2 } = 2a 2 

( C )^=(2-|)^ 

13.9. A random process is given by 

x(f) = y e~'u(t — z) 

where y and z are random variables uniformly distributed in the range (—1. 1). Sketch five sample 
functions. 

13.10. A random process is given by 



x(f) = 2 + 


y t_ 
V2 


where y is a random variable with a probability-density function 


Py(y) = 


x/27t 


-rr* 


for —oo < y < oo 


Find the first-order probability-density function of x(f). 

13.11. A random process is given by 


x(f) = zcos(a>of + y) 

Find the first-order probability-density function of x(r). 

(a) If z is a random variable distributed uniformly in the range (—1, 1) and y is a constant. 

(b) If y is a random variable distributed uniformly in the range (—tt, n) and z is a constant. 

13.12. Find the mean, mean square, and autocorrelation for the process in Prob. 13.10. Is the process stationary? 

13.13. Repeat Prob. 13.12 for the processes in Prob. 13.11. 

13.14. A stationary discrete-time random process is given by 


x(nT) = Itfxfnr)} + xo(nT) 


where xo (nT) is a zero-mean process. Show that 
(a) r x ( 0) = E{x 2 {nT)} 

0 b ) r x (-kT) = r x (kT) 

(c) r x { 0) > \r x (kT)\ 

(d) r x (kT) = [E{x(nT)}f + r Xo {kT) 

13.15. Explain the physical significance of 

(a) E[x{nT)} 

(b) E 2 {x{nT)} 

(c) £(x 2 (nr)] 

(d) a 2 = E{x\nT )} - [E{x(nT)}f 

13.16. A discrete-time random process is given by 


x(nT) = 3 + 4nTy 
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where y is a random variable with a probability-density function 


Py(y) = 


1 „-(y-4) 2 /8 

2V2^ 


for —txi < y S °o 


Find its mean, mean square, and autocorrelation. 

13.17. A discrete-time random process is given by 


x(nT) = zcos 


T 


+ 


where z is a random variable distributed uniformly in the range (0, 1). Find the mean, mean square, and 
autocorrelation of x(nT). Is the process stationary? 

13.18. A discrete-time random process is given by 


x(nT) = V2 cos(a>onT + y) 


where y is a random variable uniformly distributed in the range (—7r, n). 

(a) Find the mean, mean square, and autocorrelation of x(nT). 

(b) Show that the process is wide-sense stationary. 

(c) Find the PSD of x(nT). 

13.19. The random process of Prob. 13.18 is processed by a digital filter characterized by 

H{e» T )={ \ 

0 otherwise 


Sketch the input and output power-density spectrums if a>o < co c . 

13.20. A random process x(nT) with a probability-density function 


Px(x\nT) 


for \ < x < \ 
otherwise 


is applied at the input of the filter depicted in Fig. P13.20. Find the output PSD if x(nT) and x(kT) 
(n k) are statistically independent. 



Figure P13.20 
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CHAPTER 

14 


EFFECTS 
OF FINITE 
WORD 
FENGTH IN 
DIGITAF 
FIFTERS 


14.1 INTRODUCTION 

In software as well as hardware digital-filter implementations, numbers are stored in finite-length 
registers. Consequently, if coefficients and signal values cannot be accommodated in the available 
registers, they must be quantized before they can be stored. Number quantization gives rise to three 
types of errors: 

1. Coefficient-quantization errors 

2. Product-quantization errors 

3. Input-quantization errors 

The transfer-function coefficients are normally evaluated to a high degree of precision during 
the approximation step. If coefficient quantization is applied, the frequency response of the resulting 
filter may differ appreciably from the desired response, and if the quantization step is coarse, the 
filter may actually fail to meet the desired specifications. 
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Product-quantization errors arise at the outputs of multipliers. Each time a signal represented 
by b\ digits is multiplied by a coefficient represented by bo digits, a product having as many as b\ +£>2 
digits is generated. Since a uniform register length must, in practice, be used throughout the filter, 
each multiplier output must be rounded or truncated before processing can continue. These errors 
tend to propagate through the filter and give rise to output noise commonly referred to as output 
roundoff noise. 

Input-quantization errors arise in applications where digital filters are used to process 
continuous-time signals. These are the errors inherent in the analog-to-digital conversion process 
(see Sec. 6.9). 

This chapter begins with a review of the various number systems and types of arithmetic that can 
be used in digital-filter implementations. It then describes various methods of analysis and design that 
can be applied to quantify and minimize the effects of quantization. Section 14.3 deals with a method 
of analysis that can be used to evaluate the effect of coefficient quantization and Sec. 14.4 describes 
two families of filter structures that are relatively insensitive to coefficient quantization. Section 14.5 
deals with methods by which roundoff noise caused by product quantization can be evaluated, and 
Secs. 14.6-14.8 describe methods by which roundoff noise can be reduced or minimized. In Sec. 14.9, 
two types of parasitic oscillations known as quantization and overflow limit cycles are considered in 
some detail and methods for their elimination are described. 

14.2 NUMBER REPRESENTATION 

The hardware implementation of digital filters, like the implementation of other digital hardware, is 
based on the binary-number representation. 

14.2.1 Binary System 

In general, any number N can be expressed as 

n 

N = by (14.1) 

i=—m 

where 0 < b t < r - 1 

If distinct symbols are assigned to the permissible values of b the number N can be represented by 
the notation 

N = (b n b n -1 • • • b 0 .b -1 • • • b- m \ (14.2) 

The parameter r is said to be the radix of the representation, and the point separating N into two 
parts is called the radix point. 

If r — 10, Eq. (14.2) becomes the decimal representation of N and the radix point is the 
decimal point. Similarly, if r = 2 Eq. (14.2) becomes the binary representation of N and the radix 
point is referred to as the binary point. The common symbols used to represent the two permissible 
values of b, are 0 and 1. These are called bits. 
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A mixed decimal number can be converted into a binary number through the following steps: 

1. Divide the integer part by 2 repeatedly and arrange the resulting remainders in the reverse order. 

2. Multiply the fraction part by 2 and remove the resulting integer part; repeat as many times as 
necessary, and then arrange the integers obtained in the forward order. 

A binary number can be converted into a decimal number by using Eq. (14.1). 


Example 14.1 


(a) Form the binary representation of N = 18.375io- (b) Form the decimal 
representation of N = 11.1012- 

■ Solution 

(a) The binary representation can be carried out as follows: 


18 



2 x 0.375 

= 0.75 

2 x0.75 

= 1.5 

2 x 0.5 

= 1.0 

2 xO 

= 0 


Hence, we get 

18.375io = 10010.011 2 ■ 

(b) From Eq. (14.1) 

11.101 2 = 1(2*) + 1(2°) + 1(2 -1 ) + 0(2 -2 ) + 1(2 -3 ) = 3.625 


10 


The most basic electronic memory device is th e flip-flop which can be either in a low or a high 
state. By assigning a 0 to the low state and a 1 to the high state, a single-bit binary number can be 
stored. By arranging n flip-flops in juxtaposition, as in Fig. 14.1a, a register can be formed that will 
store an n-bit number. 

A rudimentary 4-bit digital-filter implementation is shown in Fig. 14.1 b. Registers R y and R p 
are used to store the past output y(n — 1) and the multiplier coefficient p, respectively. The output 
of the multiplier at steady state is by(n — 1). Once a new input sample is received, the adder goes 
into action to form the new output y(n), which is then used to update register R y . Subsequently, the 
multiplier is triggered into operation and the product by(n — 1) is formed. The cycle is repeated when 
a new input sample is received. 
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(«) 



(b) 


Figure 14.1 ( a ) Register, ( b ) rudimentary digital-filter implementation. 

A filter implementation like that in Fig. 14.1 b can assume many forms, depending on the type 
of machine arithmetic used. The arithmetic can be of the fixed-point or floating-point type and in 
each case various conventions can be used for the representation of negative numbers. The two types 
of arithmetic differ in the way numbers are stored in registers and in the way by which they are 
manipulated by the digital hardware. 

14.2.2 Fixed-Point Arithmetic 

In fixed-point arithmetic, the numbers are usually assumed to be proper fractions. Integers and mixed 
numbers are avoided because (1) the number of bits representing an integer cannot be reduced by 
rounding or truncation without destroying the number and (2) mixed numbers are more difficult to 
multiply. For these reasons, the binary point is usually set between the first and second bit positions 
in the register, as depicted in Fig. 14.2a. The first position is reserved for the sign of the number. 

Depending on the representation of negative numbers, fixed-point arithmetic can assume three 
forms: 

1. Signed magnitude 

2. One’s complement 

3. Two’s complement 
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Signed mantissa 


Signed exponent 


lb) 


Figure 14.2 Storage of (a) fixed-point numbers, ( b ) floating-point numbers. 


In the signed-magnitude arithmetic a fractional number 

N = ±0.£>„i£>_2 • ■ ■ b- m 


is represented as 


N sl 


0 .6 _i&_2 ■ 

' b—m 

for N > 

l.b-ib-2-- 

' b—m 

for N < 


The most significant bit is said to be the signbit;e.g., if IV = +0.1 101 or —0.1001, then /V v ,„ = 0.1101 
or 1.1001. 

The one ’s-complement representation of a number N is defined as 


Ni 


N 

for IV > 0 

2 — 2~ l — \N | 

for IV < 0 


(14.3) 


where L, referred to as the word length , is the number of bit locations in the register to the right of 
the binary point. The binary form of 2 — 2~ L is a string of Is filling the L+ 1 locations of the register. 
Thus, the one’s complement of a negative number can be deduced by representing the number by 
L + 1 bits, including zeros if necessary, and then complementing (changing 0s into Is and Is into 
0s) all bits; e.g., if IV = —0.11010, then N\ = 1.00101 for L = 5 and N\ = 1.00101111 for L = 8. 
The two ’s-complement representation is similar. We now have 


N for N > 0 

2 — |1V| for iV <0 


N 2 = 
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The two’s complement of a negative number can be formed by adding 1 at the least significant 
position of the one’s complement. Similarly, a negative number can be recovered from its two’s 
complement by complementing and then adding 1 at the least significant position. 

The possible numbers that can be stored in a 4-bit register together with their decimal equiv¬ 
alents are listed in Table 14.1. Some peculiarities of the three systems are evident. The signed- 
magnitude and the one’s-complement systems have two representations for zero whereas the two’s- 
complement system has only one. On the other hand, — 1 is represented in the two’s-complement 
system but not in the other two. 

The merits and demerits of the three types of arithmetic can be envisaged by examining how 
arithmetic operations are performed in each case. 

One’s-complement addition of any two numbers is carried out by simply adding their one’s 
complements bit by bit. A carry bit at the most significant position, if one is generated, is added at the 
least significant position ( end-around carry). Two’s-complement addition is exactly the same except 
that a carry bit at the most significant position is ignored. Signed-magnitude addition, on the other 
hand, is much more complicated as it involves sign checks as well as complementing and end-around 
carry [1]. 

In the one’s- or two’s-complement arithmetic, direct multiplication of the complements does 
not always yield the product, and as a consequence special algorithms must be employed. By contrast, 
signed-magnitude multiplication is accomplished by simply multiplying the magnitudes of the two 
numbers bit by bit and then adjusting the sign bit of the product. 


Table 14.1 Decimal equivalents of numbers 0.000 to 1.111 


Decimal equivalent (eighths) 

Binary - 

number Signed magnitude One’s complement Two’s complement 


0.000 

0 

0 

0 

0.001 

1 

1 

1 

0.010 

2 

2 

2 

0.011 

3 

3 

3 

0.100 

4 

4 

4 

0.101 

5 

5 

5 

0.110 

6 

6 

6 

0.111 

7 

7 

7 

1.000 

-0 

-7 

-8 

1.001 

-1 

-6 

-7 

1.010 

-2 

-5 

-6 

1.011 

-3 

-4 

-5 

1.100 

-4 

-3 

-4 

1.101 

-5 

-2 

-3 

1.110 

-6 

-1 

-2 

1.111 

-7 

-0 

-1 
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_Form the sum 0.53125 + (—0.40625) using the one’s- and two’s-complement 

additions assuming a word length of 5 bits. 


Example 14.2 


■ Solution 

0.53125io = 0.10001 2 
0.4062510 = O.OIIOI2 



One’s complement 

Two’s complement 

0.53125 

0.10001 

0.10001 

-0.40625 

1.10010 

1.10011 

0.12500 

4 . 0.00011 
—* 1 

1 0.00100 


0.00100 



An important feature of the one’s- or two’s-complement addition is that a machine-representable 
sum S = ni + 112 + ••• + «! + ••• will always be evaluated correctly, even if overflow does occur 
in the evaluation of partial sums. 


Example 14.3 


L = 3. 


Form the sum 


g + (— |) using the two’s-complement addition. Assume 


■ Solution 


From Table 14.1 



7/8 

0.111 


+ 4/8 

0.100 


11/8 

1.011 

incorrect partial sum 

- 6/8 

+ 1.010 


5/8 

0.101 

correct sum ■ 


14.2.3 Floating-Point Arithmetic 

There are two basic disadvantages in a fixed-point arithmetic: (1) The range of numbers that can be 
handled is small; e.g., in the two’s-complement representation the smallest number is —1 and the 
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largest is 1 — 2~ L . (2) The percentage error produced by truncation or rounding tends to increase as 
the magnitude of the number is decreased. For example, if numbers 0.11011010 and 0.000110101 
are both truncated such that only 4 bits are retained to the right of the binary point, the respective 
errors will be 4.59 and 39.6 percent. 

These problems can be alleviated to a large extent by using a floating-point arithmetic. In this 
type of arithmetic, a number N is expressed as 


N = M x 2 e 


(14.4) 


where e is an integer and 


1 

- < M < 1 
2 “ 

M and e are referred to as the mantissa and exponent, respectively. For example, numbers 0.00110101 
and 1001.11 are represented by 0.110101 x 2~ 2 and 0.100111 x 2 4 , respectively. Negative numbers 
are handled in the same way as in fixed-point arithmetic. 

Floating-point numbers are stored in registers, as depicted in Fig. 14.2 b. The register is subdi¬ 
vided into two segments, one for the signed mantissa and one for the signed exponent. 

Floating-point addition is carried out by shifting the mantissa of the smaller number to the 
right and increasing the exponent until the exponents of the two numbers are equal. The mantissas 
are then added to form the sum, which is subsequently put back into the normalized representation 
of Eq. (14.4). Multiplication is accomplished by multiplying mantissas, adding exponents, and then 
readjusting the product. 

It should be mentioned that the above scheme is just one of many. Nowadays most computers 
and digital hardware are designed to work with the IEEE floating-point representation format known 
as the ANSI/IEEE Standard 754-1985, which is, in effect, a variation of the above scheme. In the 
IEEE format, an arbitrary number N is represented as 


N = S x 2 e+bias 


where S is a signed mixed number in the range 1 to 2 — 2 L where L is the number of significant bits 
allowed in the fractional part of S and bias is an integer. S is commonly referred to as the significand 
[ 1 ]. 

The two obvious differences between the IEEE representation and the generic one in Eq. (14.4) 
is that, first, S has an integer part and, second, a biased representation is used for the exponent. 

Normalizing numbers to the range 1 to 2 — 2 ~ L , that is, 1.000 ■ ■ • 000 to 1.Ill - Ill, would 
cause the integer part of all numbers to be unity and, as a consequence, it would not need to be 
stored. Thus number precision can be increased by one bit without increasing the cost of hardware. 
The missing unity can be assumed by the software or hardware implementation. 

The use of a biased exponent eliminates the need to deal with negative numbers, which simpli¬ 
fies the arithmetic a great deal, but it introduces another problem. If the exponent in some application 
is allowed to assume values, say, between —256 to +256, a bias of 256 can be added to all expo¬ 
nents to achieve an exponent range of 0 to 512. In such a scheme, exponents e\ and e2 would be 
represented by e\ + bias and ei + bias. In the case of floating-point multiplication, the exponents 
would need to be added in which case a sum of e\ + e^ + 2bias would be produced. Evidently, in 
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order to achieve a ‘biased’ sum, an amount bias would need to be subtracted from the sum. In the 
case of floating-point division, an exponent e 2 would need to be subtracted from an exponent e\ and, 
consequently, a difference e\ — e.i would be produced. In effect, in the case of subtraction, an amount 
bias would need to be added to get a biased representation. Multiplication and division of biased 
numbers would, of course, need much more attention, as can be readily verified, but, fortunately, 
these operations are not needed when dealing with the exponents in floating-point arithmetic. 

Summarizing, the use of a biased representation eliminates the need to deal with negative 
exponents but it introduces the problem of keeping taps on the flow of the bias and the question 
remains as to whether a biased representation is more cost effective. It turns out that if a bias which is 
a power of two minus 1 is used, i.e., bias = 2 Le — 1 where L e is an integer, correcting for the bias is 
greatly simplified and the IEEE format becomes the floating-point representation of choice. Further 
details about the IEEE format as well as more information on computer arithmetic in general can be 
found in Parhami [ 1 ]. 

Floating-point arithmetic leads to increased dynamic range and improved precision of pro¬ 
cessing. Unfortunately, it also leads to increased cost of hardware (or more complicated software) 
and to reduced speed of processing. The reason is that more software/hardware is needed since 
both the significand (or mantissa) and exponent have to be manipulated. For software non-real-time 
implementations on general purpose digital computers, floating-point arithmetic is always preferred 
since neither the cost of hardware nor the speed of processing is a significant factor. 

14.2.4 Number Quantization 

Once the register length in a fixed-point implementation is assigned, the set of machine representable 
numbers is fixed. If the word length is L bits (excluding the sign bit), the smallest number variation 
that can be represented is a 1 at the least significant register position, which corresponds to 2~ L . 
Therefore, any number consisting of B bits (excluding the sign bit), where B > L, must be quantized. 
This can be accomplished (1) by truncating all bits that cannot be accommodated in the register, and 
(2) by rounding the number to the nearest machine-representable number. 

Obviously, if a number x is quantized, an error s will be introduced given by 


e = x-Q[x] (14.5) 

where Q[x] denotes the quantized value of x. The range of e tends to depend on the type of number 
representation and also on the type of quantization. Let us examine the various possibilities, starting 
with truncation. 

As can be seen in Table 14.1, the representation of positive numbers is identical in all three 
fixed-point representations. Since truncation can only reduce a positive number, s is positive. Its 
maximum value occurs when all disregarded bits are Is, in which case 

0 < St < 2~ L — 2~ b for x > 0 

For negative numbers the three representations must be considered individually. For the signed- 
magnitude representation, truncation will decrease the magnitude of the number or increase its signed 
value, and hence Q[x] > x or 


—(2 -l - 2~ b ) < e T < 0 for x < 0 
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The one ^complement representation of a negative number 

B 

* = -£ b-i2~' (14.6) 

i= 1 

(where = 0 or 1) is obtained from Eq. (14.3) as 

B 

Xi = 2-2~ L -^2 b-i2-‘ 
i=i 

If all the disregarded bits are Os, obviously e = 0. At the other extreme if all the disregarded bits are 
Is, we have 


Q[ Xl ] = 2-2~ L -J2 b -i 2 ~‘ ~ ( 2_i - 2_B ) 


! = 1 


Consequently, the decimal equivalent of Q[x\] is 


Q[x] = - 

and, therefore, from Eqs. (14.5)-(14.7) 


J2b_i2~‘ + (2 ~ l - 2~ b ) 


i =1 


(14.7) 


0<£r<2 L — 2 B for x < 0 


The same inequality holds for two’s-complement numbers, as can easily be shown. In summary, for 
signed-magnitude numbers 


—q < St < q 

where q = 2~ L is the quantization step, whereas for one’s- or two’s-complement numbers 

0 < s T < q 

Evidently, quantization errors can be kept as low as desired by using a sufficiently large value of L. 

For rounding, the quantization error can be positive as well as negative by definition, and its 
maximum value is q/2. If numbers lying halfway between quantization levels are rounded up, we 
have 


-§<«*<§ ( 14 - 8 ) 

Rounding can be effected, in practice, by adding 1 at position L + 1 and then truncating the number 
to L bits. 
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< 2 « 





Figure 14.3 Number quantization: (a) Quantizer, ( b ) to ( d ) Q(x) versus x. 


A convenient way of visualizing the process of quantization is to imagine a quantizer with 
input x and output Q[x]. Depending on the type of quantization, the transfer characteristic of the 
device can assume one of the forms illustrated in Fig. 14.3. 

The range of quantization error in floating-point arithmetic can be evaluated by using a similar 
approach. 


14.3 COEFFICIENT QUANTIZATION 

Coefficient-quantization errors introduce perturbations in the zeros and poles of the transfer function, 
which in turn manifest themselves as errors in the frequency response. Product-quantization errors, 
on the other hand, can be regarded as noise sources that give rise to output roundoff noise. Since 
the importance of the two types of errors can vary considerably from application to application, it is 
frequently advantageous to use different word lengths for the coefficient and signal values. The co¬ 
efficient word length can be chosen to satisfy prescribed frequency-response specifications, whereas 
the signal word length can be chosen to satisfy a signal-to-noise ratio specification. 
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0)p 0) a 

Figure 14.4 Coefficient quantization. 


Consider a digital filter characterized by H(z) and let 

M(co) = II(eJ"‘ T )\ = amplitude response without quantization 
Mq(co ) = amplitude response with quantization 
M/(<y) = ideal amplitude response 

S p (8 a ) = passband (stopband) tolerance on amplitude response 

These quantities are illustrated in Fig. 14.4. 

The effect of coefficient quantization is to introduce an error AM in M(a)) given by 

AM = M(to) - M q (co) 

The maximum permissible value of | AM\, denoted by AM m . dx (a>), can be deduced from Fig. 14.4 as 

( 8 p — | M(a>) — M/(®)| for a> < co p 
A M max (w) = < 

[8 a — \M(co) — Mi(co)\ for a> > co a 

and if 


\AM\ < A M max (m) (14.9) 

for 0 < co < a>p and a>„ < o> < co s /2, the desired specification will be met. The optimum word length 
can thus be determined exactly by evaluating | AM \ as a function of frequency for successively larger 
values of the word length until Eq. (14.9) is satisfied. Evidently, this is a trial-and-error approach 
and may entail considerable computation. 

An alternative approach is to employ a statistical method proposed by Avenhaus [2] and later 
modified by Crochiere [3]. This method yields a fairly accurate estimate of the required word length 
and is, in general, more efficient than the exact method described. Its details follow. 
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Consider a fixed-point implementation and assume that quantization is carried out by rounding. 
From Eq. (14.8) the error in coefficient c,- (i = 1,2,..., m), denoted as Ac,-, can assume any value 
in the range — q/2 to +q/ 2; that is, Ac, is a random variable. If the probability density of Ac, is 
assumed to be uniform, that is, 


p(Aa) = 


for — | < Ac,- < | 
otherwise 


then from Eqs. (13.8) and (13.10) 


£■{ Ac,} = 0 


a Ac, 


12 


(14.10) 

(14.11) 


The variation AM in M(a> ) is also a random variable. By virtue of Taylor’s theorem we can 

write 


m 

AM = J2 A CiS A 
1 = 1 


where the quantity 


cM _ 9M(eo) 

c ‘ da 

is known as the sensitivity of the amplitude response M(co) with respect to variations in coefficient c,-. 
Evidently, 

m 

£{AM} = Y2 S™E{Aa} = 0 

i= 1 

according to Eq. (14.10). If Ac, and Ac, (i f j ) are assumed to be statistically independent, then 
from Eq. (13.7) 

m 

°Im = ct a c , (Sf ) 2 


and, therefore, from Eq. (14.11) 


& A - 


? o2 

<TM 

12 


(14.12) 


where 


s 2 t = E «) 2 


( 14 . 13 ) 
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For a large value of m, AM is approximately Gaussian by virtue of the centrcil-limit theorem 
[4], and since E{AM} — 0, Eq. (13.1) gives 


p(AM) 


1 


ctamV2tt 


e for —oo < AM 


< oo 


Consequently, AM will be in some range —AM\ < AM < AM\ with a probability y given by 

^ r AM\ 

y = ¥x[\AM\ < AM l ]= - — e“ 4M2/2ff “ d(AM) (14.14) 

Jo 


O AM'J'l'Jt . 


With the variable transformation 


AM = xcta m A Mi = x\Oam 


(14.15) 


Equation (14.14) can be put in the standard form 

9 r x ' 

y=-j=\ e~ x 11 dx 
V27T Jo 

Once an acceptable confidence factor y is selected, the corresponding value of can be obtained 
from published tables or by using a numerical method. The quantity A M\ is essentially a statistical 
bound on AM, and if the word length is chosen such that 

A Mi < AM max (<y) (14.16) 


the desired specifications will be satisfied to within a confidence factor y. The resulting word length 
can be referred to as the statistical word length. A statistical bound on the quantization step can be 
deduced from Eqs. (14.12), (14.15), and (14.16) as 

a/ 12AM max (&>) 

q < - -(14.17) 

X\St 

The register length should be sufficiently large to accommodate the quantized value of the 
largest coefficient; so let 


j 

<2[max c,] = ^2 h? 

i=-K 

where b j and b.. K ^0. The required word length must be 

L = l + j + K (14.18) 


and since q = 2 K or 


K = log. 


1 

q 


(14.19) 
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Eqs. (14.17)—(14.19) now give the desired result as 


L > L(co) = 1 + / + log 2 


x\S T 

Vl2A M max (co) 


A reasonable agreement between the statistical and exact word lengths is achieved by using 
x\ = 2 [3, 5]. This value of x\ corresponds to a confidence factor of 0.95. 

The amplitude-response sensitivities ,S' f M in Eq. (14.13) can be efficiently computed as follows. 
The sensitivity of the frequency response with respect to a multiplier coefficient c can be expressed 
as 


S?{e ja>T ) = [Sc(e j0>T )\ + j3m [S?(.e jaT j\ 

and if 

H(e i0>r ) = M(co)e je(a)) 

we can show that 

r h i dM(co) 3 0(a>) 

me \S?(e jeoT )] = [cos 6»(co>] — - M(a>)[sin0(«)]^^ 

3c 3c 

r h if>T i 3M(«) 3 0(a>) 

3m \S^(e ]coT )] = [sin 0(cu)] — + M(a.)[cos0(ai)]^^ 

3c 3c 

Therefore, 


M = dmco) = [cos0(ft))] me s ff (e J 0 > T) + [sin 3m S?(e ja,T ) 

3c 


and 


0 = 30M = 1 {[COS 0 (W)] 3m S?(e J0,T )- [sin0(«)] XeS?(e iaT )} 

3c M(co) 

where S° c is the sensitivity of the phase response 0(a>) with respect to coefficient c. Now given an 
arbitrary digital-filter network incorporating a multiplier with a coefficient c, the sensitivity of the 
transfer function of the network can be obtained by using the transpose approach as 


H = dH(z) = Hv(z)Hu(z) 

3c 


where ll\ 2 (z) and H^iz) are the transfer functions form the input of the network to the input of 
the multiplier and from the output of the multiplier to the output of the network, respectively (see 
pp. 125-128 of [6]). 

With the transfer function sensitivities known, the amplitude-response sensitivities can be 
deduced and thus St, q, and K can be evaluated using Eqs. (14.13), (14.17), and (14.19), respectively. 
In turn, the statistical word length in Eq. (14.18) can be obtained. 
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The statistical word length is a convenient figure of merit of a specific filter structure, ft can 
serve as a sensitivity measure in studies where a general comparison of various structures is desired, 
ft can also be used as an objective function in word-length optimization algorithms [3]. 

A different approach for the study of quantization effects was proposed by Jenkins and Leon 
[7]. In this approach a computer-aided analysis scheme is used to generate confidence-interval error 
bounds on the time-domain response of the filter. The method can be used to study the effects of 
coefficient or product quantization in fixed-point or floating-point implementations. Furthermore, 
the quantization can be by rounding or truncation. 


14.4 LOW-SENSITIVITY STRUCTURES 

The effects of coefficient quantization are most serious in applications where the poles of the transfer 
function are located close to the unit circle |z| = 1. In such applications, small changes in the 
coefficients can cause large changes in the frequency response of the filter, and in extreme cases 
they can actually cause the filter to become unstable. In this section, we show that second-order 
structures can be derived whose sensitivity to coefficient quantization is much lower than that of 
the standard direct realizations described in Chap. 8. These structures can be used in the cascade or 
parallel realizations for the design of high-selectivity or narrow-band filters. 

Let M(a>) be the amplitude response of a digital-filter structure and assume that b is a multiplier 
constant. Now let A M(&>) be the change in M(co) due to a quantization error A b in b. The normalized 
sensitivity of M(a>) with respect to b is defined as 


= lim 

° Ab^O 


A M{co) 

M(a>) 
A b 
b 

b dM(a>) 
M(a>) db 


and for small values of A b, we have 


A M(w) _ A b. M 
M(cd) ~ b 


(14.20) 


(14.21) 


The normalized sensitivity can be used to compare different structures. 

Consider the direct realization of Fig. 14.5a. Straightforward analysis gives the transfer function 


H(z) = 


1 

Z 2 + b\z + b 0 


and hence the amplitude response of the realization can be readily obtained as 


1 

[l + bl + b\ + 2b \{1 + b 0 )cosa>T + 2b 0 cos2coT] 1/2 


M(a>) = 


(14.22) 
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(a) 



Figure 14.5 ( a ) Second-order direct realization, ( b ) corresponding low-sensitivity realization. 


Using Eqs. (14.20) and (14.22), the normalized sensitivities of M(o>) with respect to bo and b\ 
can be obtained as 

Sf? o = —bo(bo + b\ cos coT + cos 2&>7’)[M(a>)] 2 
S" = -bi [bi + (1 + b Q ) cos wT][M(co)) 2 

A modified version of the structure in Fig. 14.5 a can be obtained by replacing each of the 
multipliers by two multipliers in parallel, as shown in Fig. 14.5£>, as suggested by Agarwal and 
Burrus [8]. The transfer function of the original structure will be maintained in the new structure if 


bo = 1 + Po and b\ = ^ - 2 
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and from Eq. (14.20) 


; M = Po dM(a>) = Podbo 
,p ° M(co) 3/So b Q dPo 


X 


bo d M(co) 
M(co) dbo 


~ l + /0o b ° 


(14.23) 


and 


f = Pi 3 MW = 

Pl M(co) 3/0! b x 3/01 


x 


b\ dM(co) 
M(co) 3 b\ 



(14.24) 


Now if the poles of the transfer function are located close to the point z = 1, as may be the case in a 
narrow-band lowpass filter of high selectivity, then bo ~ 1 and b\ ~ —2. As a consequence, fio and 
/0i will be small and, therefore, from Eqs. (14.23) and (14.24) 



In effect, if coefficients Po and p\ are represented to the same degree of precision as coefficients bo 
and b \, then the use of the structure in Fig. 14.5 b instead of that in Fig. 14.5a leads to a significant 
reduction in the sensitivity to quantization errors, as can be seen from Eq. (14.21). The same degree 
of precision in the representation of the coefficients can be achieved by using either floating-point or 
fixed-point arithmetic. In the latter case, each multiplier coefficient should be scaled up to eliminate 
any zeros between the binary point and the most significant nonzero bit and the product scaled down 
by a corresponding shift operation. 

The structure of Fig. 14.5b, like other structures in which all the outputs of multipliers are 
inputs to one and the same adder, has the advantage that the quantization of products can be carried 
out using one quantizer at the output of the adder instead of one quantizer at the output of each 
multiplier. Structures of this type are suitable for the application of error-spectrum shaping, which 
is a technique for the reduction of roundoff noise (see Sec. 14.8). 

The disadvantage of the structure of Fig. 14.5b is that the low-sensitivity property can be 
achieved only if the poles of the transfer function are close to point z = 1. A family of structures that 
are suitable for the application of error-spectrum shaping and simultaneously lead to low sensitivity 
for a variety of pole locations close to the unit circle |z| = 1 can be obtained from the general 
second-order configuration depicted in Fig. 14.6 by using a method reported by Diniz and Antoniou 
[9]. In this configuration, branches A, B , C, D, and E represent unit delays or machine-representable 
multiplier constants, such as, 0, ±1, or ±2. 

The structure of Fig. 14.6 realizes the transfer function 



(14.25) 


where N(z) depends on the choice of multiplier coefficients cq to C 2 and 

D{z) = z 2 ( 1 — BD — AC — m\A + ABE + moAB + ABCD + m\ABD ) 


(14.26) 
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Figure 14.6 General second-order direct realization. 


Assuming that //(-) is of the form 


H(z) = 


aiz 2 + a\z + ao 
z 2 + b\z + b 0 


(14.27) 


and then comparing Eq. (14.25) with Eq. (14.27), a number of second-order structures can be deduced. 
In order to avoid delay-free loops (see Sec. 4.8.1) and keep the number of delays to the minimum of 
two, the constraints 


A = z 1 and B or D = z 1 

must be satisfied. Therefore, two cases are possible, namely. Case I where A = B = z _1 and Case 
II where A — D = z” 1 . 


14.4.1 Case I 

For Case I, polynomial D(z) of Eq. (14.26) assumes the form 

D(z) = z 2 — z(C + D + mi) + CD + m x D + m 2 + E 
and to achieve low sensitivity, multipliers C, D, and E must be chosen as 

C + D = I R [-bi] and E = I R [b 0 + biD + D 2 ] 


(14.28) 





























636 DIGITAL SIGNAL PROCESSING 


where I R [x] is the closest integer to x. Equation (14.28) forces the values of m \ and ;;i 2 to be as low 
as possible and, as in the structure of Fig. 14.5 b, low sensitivity is assured. 

If the poles are close to point z = 1, then b\ ~ —2 and bo ^ 1, and so 

C + D = 2 


We can thus assign 


C = 1 D = 1 and E = 0 

This choice of coefficients gives the structure of Fig. 14.5b, which is suitable for values of b\ in 
the range —2.0 < b\ < —1.5. Proceeding in the same way, the 15 structures in Table 14.2 can be 
deduced [9]. Structure 1-2, like 1-1, was reported in [8]. 

14.4.2 Case II 

For Case II, polynomial D(z) of Eq. (14.26) assumes the form 

D(z) = z 2 — z(B + C + m\ — mzB — BE) + BC + ni\B 


Table 14.2 Structures for Case I 


Structure 

C 

D 

E 

Range of b\ 

1-1 

1 

1 

0 

-2.0 <bi < -1.5 

1-2 

2 

0 

1 


1-3 

0 

2 

1 

-2.0 <bi < -1.75 

1-4 

0 

2 

2 

-1.75 <bi< -1.5 

1-5 

1 

0 

1 

-1.5 <bi < -0.5 

1-6 

0 

1 

1 


1-7 

0 

0 

1 


1-8 

-1 

1 

2 

-0.5 <b\ < 0.5 

1-9 

1 

-1 

2 


1-10 

-1 

0 

1 

0.5 < b x < 1.5 

1-11 

0 

-1 

1 


1-12 

0 

-2 

2 

1.5 < b x < 1.75 

1-13 

-2 

0 

1 

1.5 <bi < 2.0 

1-14 

-1 

-1 

0 


1-15 

0 

-2 

1 

1.75 < hi < 2.0 
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Table 14.3 Structures for Case II 


Structure 

B 

C 

E 

Range of b\ 

II-1 

1 

1 

0 

-2.0 <by < -1.5 

II-2 

1 

1 

1 

-1.5 < b x < -0.5 

II-3 

1 

1 

2 

-0.5 < b x < 0 

II-4 

-1 

-1 

2 

0 < by < 0.5 

II-5 

-1 

-1 

1 

0.5 < by < 1.5 

II-6 

-1 

-1 

0 

1.5 < by < 2.0 


and to achieve low sensitivity, constants B, C, and E must be chosen as 

B= 1 C = 1 and E = I R [by + b 0 + 1] (14.29) 

for poles with positive real part, and 

B = - 1 C = -1 and E = -I R [b x - b 0 - 1] (14.30) 

for poles with negative real part. Using Eqs. (14.29) and (14.30), the structures of Table 14.3 can be 
deduced [9]. Structure II-1 was reported by Nishimura, Hirano, and Pal [10]. 

Different biquadratic transfer functions can be realized by using the formulas in Table 14.4. 
In the above approach, the poles of the transfer function have been assumed to be close to the 
unit circle of the z plane. An alternative approach for selecting the optimum structure for a given 
transfer function, which is applicable for any pair of poles in the unit circle, was described by Ramana 
Rao and Eswaran [11], 


Table 14.4 Realization of biquadratic transfer functions 


Multiplier constant 

Case I 

Case II 

co 

Go -f- Cl \ D “b (72^2 

G\ Go 

a2 + ~B + T 2 

Cl 

a i + aiD 

a 0 

~~B 

Cl 

ai 

G2 

m\ 

—by — C — D 

b 0 

— - C 


B 

1712 

bo + byD + D 2 — E 

B B 2 
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14.5 PRODUCT QUANTIZATION 

The output of a finite-word-length multiplier can be expressed as 

Q[cix(n)] = CiX(n ) + e(n) 


where c,x(n) and ein) are the exact product and quantization error, respectively. A machine multiplier 
can thus be represented by the model depicted in Fig. 14.7a, where ein) is a noise source. 


Consider the filter structure of Fig. 14.7Z? and assume a fixed-point implementation. Each 
multiplier can be replaced by the model of Fig. 14.7a, as in Fig. 14.7c. If product quantization is 
carried out by rounding, each noise signal e, («) can be regarded as a random process with uniform 
probability density, that is, 

, , fi for-! <«<»)<! 

otherwise 


Hence, from Eqs. (13.8) and (13.9) and Sec. 13.8, we have 


E{ei{n)} = 0 

(14.31) 

E{e]in)} = 

(14.32) 

r e ,{k) — E{ei(n)ei(n + £)} 

(14.33) 


If the signal levels throughout the filter are much larger than q, the following reasonable 
assumptions can be made: (1) e,-(n) and e,(n + k) are statistically independent for any value of 
n (k ^ 0), and (2)e,(«)ande 7 («+A:) are statistically independent for any value of n or k (i ^ )).Letus 
examine the implications of these assumptions starting with the first assumption. From Eqs. (14.31)— 
(14.33) and Eq. (13.4) 

r e, (0) = E{ef(n)} = q — 


and 


i.e., 


r e Xk) 


kjt 0 


= E{eiin)}E{eiin + k)} = 0 

q 2 

r ei (k) = ,<$(&) 


where 8(k ) is the impulse function. Therefore, the power spectral density (PSD) of e,(n) is 


S ei (z) = Zr ei {k) = 


12 


(14.34) 


that is, e,(n) is a white-noise process. 

Let us now consider the implications of the second assumption. The autocorrelation of sum 
Ciin) + ej(n) is 


r et+ej(k) = E{[ei(n) + ej(n)][ei{n + k) + ej(n + £)]} 

= E{ei(n)ei(n + k )} + E{ei{n)}E{ej{n + £)} + E{ej(n)}E{e/(n + £)} 
+ E{ej(n)ej(n + k)} 
r et+e](k) = r ei (k) + r ej (k ) 


or 
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x(tl ) o- 




-o Qa [x(ny\ 


e(n) 


(a) 



ei (n) c 2 f«) £3 (n) 



(c) 


Figure 14.7 Product quantization: (a) Noise model for a multiplier, ( b) second-order canonic section, (c) 
noise model for a second-order canonic section. 


Therefore 


S ei +ej(z ) = Z[r ej (k) + r ej (k)] = S e ,(z) + S ej (z) 


i.e., the PSD of a sum of two statistically independent processes is equal to the sum of their respective 
PSDs. In effect, superposition can be employed. 
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Now from Fig. 14.7c and Eq. (13.22) 

2 5 

Sy(z) = H(z)H(z~ 1 ) Y, S et (z) + s e,(z) 

i= 1 1=3 

where H(z ) is the transfer function of the hlter, and hence from Eq. (14.34) the output PSD is given 
by 

2 2 

S v (z)= ^-H(z)H(z~ l )+^- 
O 4 

The above approach is applicable to any filter structure. Furthermore, it can be used to study 
the effects of input quantization. 

14.6 SIGNAL SCALING 

If the amplitude of any internal signal in a fixed-point implementation is allowed to exceed the 
dynamic range, overflow will occur and the output signal will be severely distorted. On the other 
hand, if all the signal amplitudes throughout the filter are unduly low, the filter will be operating 
inefficiently and the signal-to-noise ratio will be poor. Therefore, for optimum filter performance 
suitable signal scaling must be employed to adjust the various signal levels. 

A scaling technique applicable to one’s- or two’s-complement implementations was proposed 
by Jackson [12]. In this technique a scaling multiplier is used at the input of a hlter section, as in 
Fig. 14.8, with its constant X chosen such that amplitudes of multiplier inputs are bounded by M if 
\x(n)\ < M. Under these circumstances, adder outputs are also bounded by M and cannot overflow. 
This is due to the fact that a machine-representable sum is always evaluated correctly in one’s- or 
two’s-complement arithmetic, even if overflow does occur in one of the partial sums (see Example 
14.3). There are two methods for the determination of X, as follows. 

14.6.1 Method A 

Consider the hlter section of Fig. 14.8, where v(n) is a multiplier input. The transfer function between 
nodes 1 and 2 can be denoted by F(z). From the convolution summation 

OO 

v(n) = 55 Xf(k)x(n - k) (14.35) 

k=0 


b 



Figure 14.8 Signal scaling. 
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where 

Evidently 


and if 


f(n) = Z~ 1 F(z) 


OO 

\v(n)\ <^|1/(1)|- \x{n-k)\ 

k =0 


then 


\x(n )| < M 

OO 

\v(n )| < M^\Xf(k)\ 
k =0 

Thus a sufficient condition for \v(n)\ < M is 

OO 

EI W)l < 1 


k =0 


or 


A < 


1 


Er=oi/wi 

M for Xf (k) > 0 


—M forXf(k)<0 


Now consider the specific signal 

x(n — k) = 
where M > 0. From Eq. (14.35) 

OO 

v(n) = Mj2 IV(*)I 


(14.36) 


k =0 


and, therefore, |n(«)| < M if and only if Eq. (14.36) holds. Signal scaling can be applied by 
calculating the infinite sum of the magnitude of the impulse response from the input of the filter to 
the input of each multiplier and then evaluating X using the largest sum so obtained in Eq. (14.36). 

The above method guarantees that overflow will never occur as long as the input is bounded 
as prescribed. Unfortunately, the signal levels at the various nodes can be quite low and since 
quantization errors are independent of the signal level, a reduced signal-to-noise ratio may result. In 
addition, the computation of the sum in Eq. (14.36) is not usually straightforward. 


14.6.2 Method B 


The second and more efficient method for the evaluation of X is based on L p -norm notation. The L p 
norm of an arbitrary periodic function A(eJ r ’ ,T ) with period co s is defined as 


A 


1 

CO s 



1/P 


\A{e icoT )\ p dco 


P ~ 
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where p > 1. It exists if 


\A(e ja,T )\ p dco 


and if Aie 1 "' 1 ) is continuous, then the limit 


lim ||A|| p = ||A||oo = max \A{e ]aT )\ 

p —^oo 0<co<co s 


(14.37) 


exists, as can be easily demonstrated (see Prob. 14.22). Usually, AieJ‘" r ) is obtained by evaluating 
function A(z) on the unit circle z = e /V,// and || A\\ p is often referred to as the L p norm of either 
A(e j0,T ) or A{z). 

Now let 


X(z) = ^2, *(«)z " with a < |z| < b 

n——oo 

oo 

F(z) = ^2 /(«)z _ " withe < \z\ < b 


where c < 1 for a stable filter and b > 1. From Eq. (14.35) 

V(z) = XF(z)X(z) with d <\z\ < b 
where d = max (a, c). The inverse z transform of Viz) is 

v(n) = -h / XF(z)X(z)z n ~ l dz (14.38) 

2 7tj J r 

where T is a contour in the annulus of convergence. If a < 1, F can be taken to be the unit circle 
|z| = 1. With z = e ja>T Eq. (14.38) becomes 

1 


v(n) = — / XF(e jolT )X(e j,oT )e jnolT dco 
co s Jo 


We can thus write 


M«)l < 


\v(n)\ < 


max \X(e jcoT )\ — / \XF(e ja>T )\ dco 
L 0<o><o> s J CO s Jo 


max \XF(e jaT )\ 

- 0<co<o) s 


1 f MS 

— / \X(e ja,T )\dco 
J a> s Jo 


and by virtue of the Schwarz inequality [12], we can write 


M«)l < 


i r 

COs Jo 


\XF(e ja,T )\ 2 dco 


-i 1/2 


— / * \X(e JQT )\ 2 d£2 
COs Jo 


1 1/2 


If Lp-norm notation is used, Eqs. (14.39)—(14.41) can be put in the compact form 

\v(n)\ < ||X|U|*F||i |w(n)| < HXIIill^FIloo |w(n)| < ||X|| 2 ||^F|| 2 

In fact, these inequalities are particular cases of the Holder inequality [12, 13] 

K«)l < II*m|afil 


(14.39) 

(14.40) 

(14.41) 


(14.42) 
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where the relation 

^3 

II 

1 ^ 

(14.43) 

must hold. 

Equation (14.42) is valid for any transfer function XF(z) including XF(z) = 
v(n) = x(n) and || l|| p = 1 for all p > 1. Consequently, from Eq. (14.42) 

1, in which case 


|jc(«)| < ||X|| 9 for all q > 1 


Now if 

\x(n )| < ||X||, < M 


Eq. (14.42) gives 

|u(n)l < M\\XF\\ p 


Therefore, 

|u(n)| < M 


provided that 

ll^% < 1 


or 

1 

k < for ||X|| 9 < M 

IIUp 

(14.44) 


where Eq. (14.43) must hold. 


14.6.3 Types of Scaling 


Depending on the values of p and q, two types of scaling can be identified, namely, Lo scaling if 
p — q = 2 and L 00 scaling if p = oo and q — 1. 

From the definition of the L p norm and Eq. (14.37), we have 


| E || 2 = 


I / >< “ I 

— / \F(e ja>T )\ 2 dco 

u> s Jo 


T 1/2 


< 


1 


CO s Jo 

1 


max \F(e jmT )\ 


1 2 


dco 


A 1/2 


<>-] a 
< IIEIloo 


\ 1/2 


1 1 

> 


\\F \| 2 “ ||F|| C 


As a consequence, Li scaling usually yields larger scaling constants than L scaling. This means that 
the signal levels at the various nodes are usually larger, and thus a better signal-to-noise ratio can be 
achieved. However, Li scaling is more likely to cause overflow than L x scaling. The circumstances 
in which these two types of scaling are applicable are examined next. 
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If x{n) is obtained by sampling a random or deterministic, finite-energy, bandlimited, 
continuous-time signal x{t) such that 


X A (jco ) = Tx(t) — 0 for \a>\ > co s /2 


(14.45) 


we can write 


IIX || 2 = 


11/2 


1 /■“» 

— / \X(e ja,T )\ 2 dco 

co s J 0 


1 ra >,/2 I '/ 2 

— / \X(e jroT )\ 2 dco 

0>s J-o> s /2 


where X(z) = Zx(n). From Eq. (6.46a), we have 

1 


X(e JloT ) = -X A {jco) for \a>\ < ca s /2 


and hence 


\\X\\, = 


1 


2 jtT 
1 

2jtT 


riojl "I '/ 2 

\X A (jco)\ 2 dco 

- o > s /2 


1 1/2 


\X A (jco)\ 2 dco 


On using Parseval’s formula (see Theorem 2.16), we obtain 


IXII 2 = 


l 1/2 


\x(t)\ 2 dt 


(14.46) 


For a finite-energy signal, the above integral converges. Therefore, Eq. (14.42) holds with p = 2 
and q = 2, and L 2 scaling is applicable. 

If x(n) is obtained by sampling a continuous-time signal x(t) whose energy content is not 
finite (e.g., a sinusoidal signal) the integral in Eq. (14.46) does not converge, | X || 2 does not exist, 
and L 2 scaling is not applicable; therefore, if such a signal is applied to a structure incorporating L 2 
scaling, then signal overflow may occur. If x(t ) is bounded and bandlimited, Eq. (14.45) is satisfied, 
and hence we can write 

J /•£■),/ 2 

||X||i = — / \X(e JloT )\ dco 
<O s J-oiJ2 

j r<»J2 

= — \X A (jeo)\dco (14.47) 

J-(Os /2 

i.e., || 211| \ exists and Eq. (14.42) holds with p — 00 and q = 1, and scaling is applicable. The 
amplitude spectrum of x(t) may become unbounded if x(t) is a sinusoidal signal, in which case 
X A (jco) has poles on the jco axis, or if x(t) is constant, in which case X A (jco) is an impulse function. 
However, in both of these cases ||X||i exists, as will now be demonstrated. 

If x(t) = M cos coonT where 0 < coq < co s /2, we have 


X A (jco) = tt M[S(co - coo) + S(co + <«o)] 
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and Eq. (14.47) gives 

l r<Os/2 

||X|| i = ■— / \jtM[8(co — a>o) + 8(a> + ®o)]| dco 
2?r 7-o),/2 

= M 

On the other hand, if x(t) = M, then 


X A (jco) = 2i tMS(co) 


and 

j rioj 2 

11X11! = — / \2jtM8(co)\ dco = M 

2 ^ J-co s /2 

Therefore, if we select A such that 

IIA-FHoo = max \XF(e ja,T )\ < 1 

0<CO<Q) S 

then 


v(n) < M 

This result is to be expected. With a sinusoidal input and the gain between the input and node 2 in 
Fig. 14.8 equal to or less than unity, the signal at node 2 will be a sinusoid with an amplitude equal 
to or less than M. 


14.6.4 Application of Scaling 

If there are m multipliers in the filter of Fig. 14.8, then \Vj(n)\ < M provided that 


for i = 1,2,..., m. Therefore, in order to ensure that all multiplier inputs are bounded by M we 
must assign 


or 


X = min (Ai, A 2 , ..., A m ) 

1 

max(||iq|| p , ||F 2 || P , ..., ||F m || p ) 


(14.48) 


In the case of parallel or cascade realizations, efficient scaling can be accomplished by using 
one scaling multiplier per section. 


Example 14.4 


Deduce the scaling formulation for the cascade filter of Fig. 14.9a assuming 
that p = 00 and q = 1 . 


■ Solution 

The only critical signals are y'j(n) and y ; (n) since the inputs of the feedback multipliers 
are delayed versions of y'jin). The filter can be represented by the signal flow graph of 
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Fig. 14.9 b, where 

7 

By using Eq. (14.48), we obtain 

1 


Fj(z) = 


(z + l) 2 


z 2 + bijZ + b 2 j 


X 0 = 
^2 = 


max (|| F[ ||oo, II Fi ||oo) 

1 


A, = 


1 


1 0 max (HFiFjIloo, II-^ 2 IIoo) 


l 0 Xi max (HF 1 F 2 F 3 II 00 , \\FiF2F3Woo) 
The scaling constants can be evaluated by noting that 


according to Eq. (14.37). 


in/^IU = max |nW“ r )| 

0<co<co s 


X 0 



> y(n) 





-O y/n) 


x(n) o— 


y{(n) 


yi(n) 
' Ffc) 




?l(n) F 2 (z) y 2 («) 

(« 

Figure 14.9 (a) Cascade filter, ( b ) signal flow-graph representation. 


-o 3> 3 (n) 
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The scaling constants are usually chosen to be the nearest powers of 2 satisfying the overflow 
constraints. In this way, scaling multiplications can be reduced to simple data shifts. 

In cascade biters, the ordering of sections has an influence on scaling, which in turn has an 
influence on the output noise. Analytical techniques for determining the optimum sequential ordering 
have not yet been devised. Nevertheless, some guidelines suggested by Jackson [14] lead to a good 
ordering. 

14.7 MINIMIZATION OF OUTPUT ROUNDOFF NOISE 

The level of output roundoff noise in fixed-point implementations can be reduced by increasing 
the word length. An alternative approach is to assume a general structure and vary its topology or 
parameters in such a way as to minimize the output roundoff noise. A method of this type that leads 
to optimal state-space structures was proposed by Mullis and Roberts [15]. The method is based 
on a state-space noise formulation reported by these authors and Hwang [16] at approximately the 
same time, and the principles involved are detailed below. The method is applicable to the general 
/Vth-order realization but for the sake of simplicity it will be presented in terms of the second-order 
case. 

A second-order state-space realization can be represented by the signal flow graph in Fig. 14.10 
where e,(n) for i = 1,2, and 3 are noise sources due to the quantization of products. From Sec. 4.8.2, 
the filter can be represented by the equations 

q (n + 1) = Aq(n) + b x[n) + e(n) (14.49a) 

y(n) — c r q(n) + dx(n ) + a («) (14.49b) 

where e T (n) = [e\(n) e 2 («)]■ Let /q(z), /* 2 (z) and Gi(z), G 2 (z) be the transfer functions from the 
input to nodes qfn), cpin) and from nodes e\(n), e 2 («) to the output, respectively. In terms of this 
notation, the column vectors f(z) and g(z) can be formed as 

f r (z)= [Fi(z)F 2 (z)] and g r (z) = [GHz) G 2 (z)] (14.50) 



a 22 


Figure 14.10 


Second-order state-space realization. 
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and from Eq. (14.49), we obtain 

f(z) = (zl - A) _1 b and g(z) = (zl - A 7 'r 1 c (14.51) 


(see Prob. 14.23). 

Now if the realization of Fig. 14.10 is represented by the set {A, b e 7 , d\ and the state vector 
q (n) is subjected to a transformation of the form q(n) = Tq(n), a new realization 

{A, b, c r , 3} 


is obtained where 

A = TAT -1 b = Tb c T = c r T~ 1 3 = d (14.52) 


and from Eq. (14.49), one can show that 

f(z) = Tf(z) and g(z) = T^gfe) 


(14.53) 


(see Prob. 14.24). The realization {A, b, c 7 , 3} has minimum output roundoff noise subject to L 2 - 
norm scaling if and only if 


W = DKD 


(14.54) 


and 


Ku Wa = Kjj Wjj for all i, j (14.55) 

where D is a diagonal matrix and K = { K,j } and W = { IT,;/ } are the matrices given by 

K = -E / f( z )F(z- 1 )z- 1 dz (14.56) 

2 nj J r 

and 

1 r . 

(14.57) 


1 

2 nj 


W = -— : (p g(z)g T (z ; )z 1 dz 


respectively [15]. Matrices K and W are known as the reachability and observability gramians, 
respectively. 

From Eq. (14.44), L 2 scaling can be applied by ensuring that 


IF’; II 2 = 1 


for all i 


(14.58) 


and from Eqs. (14.56) and (14.58), we have 


Ku = 


l 


1 

2nr j Jr 

1 r 

Jo 


Fi(z)Fj(z r )z 1 dz 


\Fi{e jcoT )\ 2 dm 


= \\Fi\\ 2 2 = 1 


(14.59) 
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Therefore, the condition for minimum output roundoff noise in Eq. (14.55) assumes the form 


Wa — Wjj for all i, j 


(14.60) 


and from Eq. (14.57), we have 


Gi ||| = || Gj ||? forallt ',7 


In effect, the output noise is minimum if the individual contributions due to the different noise sources 
are all equal , as may be expected. 

The application of the above method to the /Vth-order general state-space realization would 
require N 2 + 2N + 1 multipliers, as opposed to 2N + 1 in parallel or cascade canonic structures. 
That is, the method is uneconomical. Recognizing this problem, Mullis and Roberts applied their 
methodology to obtain so-called block-optimal parallel and cascade structures that require only 
AN + 1 and 9/V/2 multipliers, respectively. Unfortunately, in both cases the realization process is 
relatively complicated; in addition, in the latter case the pairing of zeros and poles into biquadratic 
transfer functions and the ordering of second-order sections are not optimized, and to be able to 
obtain a structure that is fully optimized the designer must undertake a large number of designs. A 
practical approach to this problem is to obtain second-order sections that are individually optimized 
and then use sections of this type in parallel or cascade for the realization of /Vth-order transfer 
functions. Realizations so obtained are said to be section-optimal. This approach gives optimal 
parallel structures since in this case the output noise is independent of the pairing of zeros and 
poles and the ordering of sections; furthermore, as was shown by Jackson, Lindgren, and Kim [17], 
with some experience the approach gives suboptimal cascade structures that are nearly as good as 
corresponding block-optimal cascade structures. 

Optimized second-order sections can be obtained by noting that Eq. (14.54) is satisfied if and 
only if D = pi, according to Eqs. (14.59) and (14.60); hence, Eq. (14.54) can be expressed as 


W = p 2 K 


(14.61) 


Since W and K are symmetric matrices with equal diagonal elements, Eq. (14.61) assumes the form 


W = P 2 JKJ 


(14.62) 


where 



for a second-order realization. Eq. (14.62) is satisfied by a network in which 

A r = JAJ 


and 


c = pjb 

If A = {dij }, b = {bj }, and c T = {c ( }, then the preceding conditions yield 


All = «22 
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and 


in _ C2 

b 2 Cl 

If {A, b, c T ,d} represents a specific realization that satisfies these conditions, then applying the 
scaling transformation 


F illj 1 0 

0 IIF2II2 1 


(14.63) 


results in a structure that satisfies Eqs. (14.54), (14.59), and (14.60) simultaneously and, therefore, 
is optimal for Li scaling. It should be mentioned that if the transformation 


F ill^o 1 0 

0 \\f 2 \\-\ 


(14.64) 


is used instead, the structure obtained is not optimal for L m scaling, although good results are usually 
obtained. 

A biquadratic second-order transfer function with complex-conjugate poles can be expressed 
as 


H(z) = 


Viz + Vo | s 
Z 2 + PlZ + Po 


(14.65) 


and on the basis of the above principles, Jackson et al. [17] obtained the following optimal state-space 
realization: 


«11 = «22 = —^l/2 

(14.66a) 

an = (1 + Yo)(Ki ± K 2 )/y{ 

(14.66b) 

«2i = [^1 T ^2] 2 /(l + yo) 

(14.66c) 

1 , 1 
b 1 = -(1 + yo) b 2 = -y\ 

(14.66d) 

Yi ~ , 

1 + yo 

(14.66e) 

d = 8 

(14.66f) 

1 

K\ = yo~ -P 1 Y 1 


k 2 = \J (y 0 2 - Yoy\P\ + PoYi) 



An arbitrary parallel or cascade design can be obtained by expressing the individual biquadratic 
transfer functions as in Eq. (14.65) and then using the scaling transformation 

T= nifuil ; 1 0 

L 0 11 ii- 1 . 

with p = 2 or 00 for each section, where Ej,(z) and F 2 j(z) are the transfer functions between the 
input of the filter and the state-variable nodes 1 and 2, respectively, of the ith section. 
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14.8 APPLICATION OF ERROR-SPECTRUM SHAPING 


An alternative approach for the reduction of output roundoff noise is through the application of 
a technique known as error-spectrum shaping [18, 19]. This technique involves the generation of 
a roundoff-error signal and the application of local feedback for the purpose of controlling and 
manipulating the output roundoff noise. The technique entails additional hardware which increases 
in direct proportion to the number of adders in the structure. Consequently, only structures in which 
the outputs of all multipliers are inputs to one and the same adder are suitable for the application of 
error-spectrum shaping. The most well-known structure of this type is the classical direct realization. 
Other structures of this type are the low-sensitivity structures described in Sec. 14.4. 

The application of error-spectrum shaping to the direct realization of Fig. 14.1 lo is illustrated 
in Fig. 14.1 lb. Signals and coefficients are assumed to be in fixed-point format using L bits for the 
magnitude and one bit for the sign, and each of the two adders A i and A 2 can add products of 2 L bits 
to produce a sum of 2L bits. Quantizer Q \ rounds the output of adder A t to L bits and simultaneously 
generates a scaled-up version of the quantization error which is fed back to adder A \ through the fi 
subnetwork. Quantizer Q 2 , on the other hand, scales down and rounds the output of adder A 2 to 2 L 
bits. A suitable scaling factor for the fi subnetwork is 2 L since the leading L bits of the quantization 
error are zeros. Constant k is used to scale the input of quantizer Q \. Assuming L 2 signal scaling, 
then 


1 


(14.67) 


k = 


where H(z) is the transfer function of the structure in Fig. 14.1 la. 

A noise model for the configuration in Fig. 14.1 lb can be readily obtained as shown in 
Fig. 14.11c, where -q -,/2 < e,(n) < e/,/2 with q\ — 2~ L and q 2 = 2~ 1L . Hence, the PSDs of 
signals e\(n) and C 2 in) are given by 



As in Sec. 14.5, the PSD of the output noise can be obtained as 



(14.68) 


where 



(14.69) 


and 


H 2 (z) = 


k(z 2 + b\z + bo) 


(14.70) 


are the transfer functions from noise sources e\(n) and e 2 (n) to the output, respectively. The output 
noise power is numerically equal to the autocorrelation of the output noise evaluated at k — 0 and 
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(«) 



(b) 


Figure 14.11 (a) Second-order direct realization, (b) application of error-spectrum shaping. 


from Eqs. (13.19a) and (14.68), we obtain 

r„(0) = a,] = 


„ ' . <£ S n (z)z 1 dz 
2 nj J r 




1 = 1 


E 


12 


Hi 


■ I 2 

II2 


(14.71) 
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(c) 


Figure 14.11 Cont’d (c) Noise model. 


For a random input signal whose amplitude is uniformly distributed in the range (—1, 1), we have 
r x (k) = a 2 — 1 /3; hence the output power due to the signal is given by 


r v (0) = a] = - \\H\\l 


(14.72) 


Now from Eq. (14.67) and Eqs. (14.69)—(14.72), the signal-to-noise ratio can be obtained as 


o\T 

SNR = -4 = 

(7,r 


4 x 2 2l 


Z + Pi Z + Po 


Z 2 + b\z + bo 


1-2 L 


1 


z 2 + biz + b 0 


If the parameters Pi and Pi are chosen to be equal to b\ and bi, respectively, then the signal-to-noise 
ratio is maximized, as demonstrated by Higgins and Munson [19]. 
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Expressions for the coefficients of the error-spectrum shaping network for the case of cascade 
structures have been derived in [20]. 

14.9 LIMIT-CYCLE OSCILLATIONS 

In the methods of analysis presented in Sec. 14.5, we made the fundamental assumption that signal 
levels are much larger than the quantization step throughout the filter. This allowed us to assume 
statistically independent noise signals from sample to sample and from source to source. On many 
occasions, signal levels can become very low or constant, at least for short periods of time, e.g., 
during pauses in speech and music signals. Under such circumstances, quantization errors tend to 
become highly correlated and can actually cause a filter to lock in an unstable mode whereby a 
steady output oscillation is generated. This phenomenon is known as the deadband effect, and the 
oscillation generated is commonly referred to as quantization or granularity limit cycle. 

Quantization limit cycles are low-level oscillations whose amplitudes can be reduced by in¬ 
creasing the word length of the implementation. Another type of oscillation that can cause serious 
problems is sometimes brought about by overflow in the arithmetic devices used. Oscillations of this 
type are known as overflow limit cycles and their amplitudes can be quite large, sometimes as large 
as the maximum signal handling capacity of the hardware. 

In this section, we examine the mechanisms by which quantization and overflow limit cycles 
can be generated and present methods for their elimination. 


14.9.1 Quantization Limit Cycles 


The deadband effect can be studied by using a technique developed by Jackson [21], Consider the 
first-order filter of Fig. 14.12a. The transfer function and difference equation of the filter are given 
by 


H{z) = 


Hqz 
Z- b 


and 


y{n) = Hqx(ji) + by(n — 1) (14.73) 

respectively. The impulse response is 


h(ri) = H 0 (bf 


If b = 1 or — 1, the filter is unstable and has an impulse response 


h(n) 


II 


for b = 1 
for b = — 1 


With //(i = 10.0 and b = —0.9, the exact impulse response given in the second column of Table 14.5 
can be obtained. 

Now, assume that the filter is implemented using fixed-point decimal arithmetic, where each 
product by(n — 1) is rounded to the nearest integer according to the rule 


Q[\by( n — 1)1 ] = Int [\by(n — 1)| + 0.5] 


(14.74) 
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Figure 14.12 (a) First-order filter, ( b ) second-order filter. 

With Hq = 10.0 and b = —0.9, the response in the third column of Table 14.5 is obtained. As can be 
seen, for n > 5 the response oscillates between +5 and —5 and, in a sense, quantization has rendered 
the filter unstable. 

If Eq. (14.73) is assumed to hold during the unstable mode, the effective value of b must be 1 
for b > 0 or — 1 for b < 0. If this is the case 

Q[\by(n - 1)|] = \y(n - 1)| 


and from Eq. (14.74) 


Int [\b\ ■ \y(n — 1)| + 0.5] = \y{n — 1)| 
or Int [\y{n — 1)| — (1 — \b\)\y(n — 1)| + 0.5] = \y{n — 1)| 

This equation can be satisfied if 

0 < —(1 — |i>|)|>’(n — 1)| + 0.5 < 1 
and by using the left-hand inequality, we conclude that 

0.5 

I y(n — 1)1 < -= k 

L V M ~ 1 - \b\ 

Since y(n — 1) is an integer, instability cannot arise if \h\ < 0.5. On the other hand, if \b\ > 0.5, the 
response will tend to decay to zero once the input is removed, and eventually y(n — 1) will assume 
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Table 14.5 Impulse response of first-order filter 


n 

h(n) 

QlHn)] 

0 

10.0 

10.0 

1 

-9.0 

-9.0 

2 

8.1 

8.0 

3 

-7.29 

-7.0 

4 

6.561 

6.0 

5 

-5.9049 

-5.0 

6 

5.31441 

5.0 

7 

-4.782969 

-5.0 

100 

2.65614 x 10 -4 

5.0 


values in the so-called deadband range [—k, k]. When this happens, the filter will become unstable. 
Any tendency of \y(n — 1) | to exceed k will restore stability, but in the absence of an input signal the 
response will again decay to a value within the deadband. Thus the filter will lock into a limit cycle 
of amplitude equal to or less than k. Since the effective value of b is +1 for 0.5 < b < 1 or —1 for 
— 1 < b < —0.5, the frequency of the limit cycle will be 0 or cn s /2. 

For the second-order filter of Fig. 14.12b, we have 

7 2 

H(z) = 


Z 2 + biz + bo 


and 


y(n) = x(n) - biy{n - 1 ) - b 0 y(n - 2 ) 


If the poles are complex, then 


where 


h(n) = 4—r sin [(« + 1)0] 
sin0 


r = Vb 0 


(14.75) 


and 

b 

0 = COS- -j=r- 

2Vb 0 

For bo = 1, the impulse response is a sinusoid with constant amplitude and frequency 

1 b x 

co o = - cos (14.76) 

This is sometimes referred to as the resonant frequency of the filter. 

In second-order filters, there are two distinct limit-cycle modes. In one mode, a limit cycle 
with frequency 0 or a > s /2 is generated, and a limit cycle whose frequency is related to the resonant 
frequency a>o is generated in the other. 








EFFECTS OF FINITE WORD LENGTH IN DIGITAL FILTERS 657 


If the filter is implemented using fixed-point decimal arithmetic and each of the products 
h\ yin — 1) and b( } y(n — 2) is rounded to the nearest integer according to the rule in Eq. (14.74), then 
Eq. (14.75) yields 


y{n) = x(n) - Q[hy(n - 1)] - Q[b 0 y(n - 2)] 


The filter can sustain a zero-input limit cycle of amplitude yo (yo > 0) and frequency 0 or co s /2 if 

yo = ±Qlbiyo]-Q[b oyo ] (14.77) 

where the plus sign applies for limit cycles of frequency w s /2 (see Prob. 14.29). Regions of the 
(bo, b\) plane that satisfy this equation and the corresponding values of yo are shown in Fig. 14.13a. 
The domain inside the triangle represents stable filters, as can be easily shown (see Eqs. (14.91a) 
and (14.91c)). 



Figure 14.13 Regions of the ( b 0 , b{) plane that yield quantization limit cycles: (a) Regions that satisfy 
Eq. (14.77). 
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(b) 


Figure 14.13 Cont’d Regions of the (bo, b i) plane that yield quantization limit cycles: ( b ) Regions that 
satisfy Eqs. (14.77) and (14.78). 


If e\(n) and e 2 (n) are the quantization errors in products b\yo and boyo, respectively, then 
Eq. (14.77) gives 

y 0 ±e l (n)±e 2 (n) 

±b i = -h b 0 

yo 

and since —0.5 < e,-(n) < 0.5, a necessary but not sufficient condition for the existence of a limit 
cycle of frequency 0 or co s /2 is obtained as 

yo — 1 

|bi| > ^- + b 0 

yo 

The second limit-cycle mode involves the quantization of product boy(n — 2). If 

Q[\boy(n - 2)|] = \y(n - 2)| 


then the effective value of bo is unity and, as in the first-order case, a condition for the existence of 
limit cycles can be deduced as 

0.5 

I y(n - 2)1 < --— = k 

1 - \b 0 \ 


(14.78) 
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With k an integer, values of bo in the ranges 

0.5 < \b 0 \ < 0.75 
0.75 < |&ol < 0.833 


2k- 1 
2k 


< \b 0 \ < 


2 k+ 1 
2(k + 1) 


will yield deadbands [—1, 1], [—2, 2],..., [—A:, k ],..., respectively. Regions of the (bo, b\) plane 
that satisfy both Eqs. (14.77) and (14.78) are depicted in Fig. 14.13ft. 

If the poles are close to the unit circle, the limit cycle is approximately sinusoidal with a 
frequency close to the resonant frequency given by Eq. (14.76). 

For signed-magnitude binary arithmetic, Eq. (14.78) becomes 


where q is the quantization step. 


I yin - 2)1 < 


q 

2(1 - | ft 0 |) 


14.9.2 Overflow Limit Cycles 

In one’s- or two’s- complement fixed-point implementations, the transfer characteristic of adders is 
periodic, as illustrated in Fig. 14.14a; as a consequence, if the inputs to an adder are sufficiently 




Figure 14.14 (a) Transfer characteristic of one’s- or two’s-complement fixed-point adder, (ft) transfer 

characteristic of adder incorporating saturation mechanism. 
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large to cause overflow, unexpected results can occur. Under certain circumstances, oscillations of 
large amplitude can be sustained, which are known as overflow limit-cycle oscillations. These were 
identified and studied quite early in the development of digital filters by Ebert, Mazo, and Taylor 
[22]. The generation of overflow limit cycles is demonstrated by the following example. 


Example 14.5 


A second-order digital filter characterized by Eq. (14.75) with b\ = —1.375 
and bo = 0.625 is implemented in terms of two’s-complement fixed-point arithmetic using a 
word length of 6 bits, excluding the sign bit. The quantization of products is carried out by 
rounding. Show that if x(n) = 0, y(— 2) = —43/64, and y(— 1) = 43/64, the filter will sustain 
an overflow limit cycle. 


■ Solution 

Using the difference equation, output y(n) given in column 2 of Table 14.6 can be readily 
computed. Evidently, y(4) = y(— 2) and y(5) = y(— 1) and, therefore, a sustained 
oscillation of amplitude 43/64 and frequency co s /2 will be generated. 

Table 14.6 Overflow limit cycle 
in second-order filter 


n 

My in) 

64y(/i) 

-2 

-43 

-43 

-1 

43 

43 

0 

-42 

63 

1 

43 

60 

2 

-43 

44 

3 

42 

23 

4 

-43 

4 

5 

43 

- 8 

6 

-42 

-14 

7 

43 

-14 

8 

-43 

-10 

9 

42 

-5 

10 

-43 

- 3 

11 

43 

- 1 

12 

-42 

1 

13 

43 

2 

14 

-43 

2 

15 

42 

2 


14.9.3 Elimination of Quantization Limit Cycles 

Quantization limit-cycle oscillations received considerable attention from researchers in the past, 
and two general approaches for minimizing or eliminating their effects have evolved. One approach 









EFFECTS OF FINITE WORD LENGTH IN DIGITAL FILTERS 661 


entails the use of a sufficiently large signal word length to ensure that the amplitude of the limit-cycle 
is small enough to meet some system specification imposed by the application. Bounds on the limit- 
cycle amplitude that can be used in this approach have been deduced by Sandberg and Kaiser [23], 
Long and Trick [24], and Green and Turner [25]. The other approach entails the elimination of limit 
cycles altogether. Quantization limit cycles can be eliminated by using appropriate signal quantiza¬ 
tion schemes in specific structures, whereas overflow limit cycles can be eliminated by incorporating 
suitable saturation mechanisms in arithmetic devices. 

An important method for the elimination of zero-input limit cycles was proposed by Meerkotter 
[26] and was later used by Mills, Mullis, and Roberts [27], and Vaidyanathan and Liu [28] to show that 
there are several realizations that support the elimination of limit-cycle oscillations. In this method, 
a Lyapunov function related to the stored power is constructed and is then used to demonstrate that 
under certain conditions limit cycles cannot be sustained. The principles involved are as follows. 

Consider the digital filter shown in Fig. 14.15 and assume that block A is a linear subnetwork 
containing adders, multipliers, and interconnections but no unit delays. Further, assume that signal 
quantization and overflow control are carried out by quantizers Qk for k — 1, 2, ..., N placed at the 
inputs of the unit delays as shown. The state-space characterization of the filter can be expressed as 

\(n) — Aq(n) + b x(n) 
y(n) = c r q(n) + dx{ri) 


and if x(n ) = 0, we can write 


v(n) = Aq(n) (14.79) 

q (n + 1) = y(n) (14.80) 

where A = [<3, y -} and D/,00 is related to i \{n) by some nonlinear and possibly time-varying functional 
relation of the form 


Vkin) = Q k [v k (.n)] for k = 1, 2, ..., N (14.81) 

The quadratic form 

p[q(n)] = q r («)Dq(«) (14.82) 

where D is an N x N positive definite diagonal matrix, is related to the power stored in the unit 
delays at instant nT, and changes in this quantity can provide information about the stability of the 


x(n) 



y(n) 


Figure 14.15 Afih-order digital filter incorporating nonlinearities. 
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filter under zero-input conditions. The increase in /?[q(/i)] in one filter cycle can be expressed as 

Ap[q(n)] = p[q(n + 1)] - p[q(n)] (14.83) 

and from Eqs. (14.80), (14.82), and (14.83), we have 

A/?[q(n)] = —q r («)Dq(n) + v r («)Dv(») (14.84) 

Hence, Eqs. (14.79) and (14.84) yield 

A/?[q(n)] = — q r («)Dq(«) + \ T (n)D\(n) + [Aq(«)] r D[Aq(«)] — v r («)Dv(n) 

N 

= —q r (n)(D - A r DA)q(«) - J> 2 («) - v 2 k (n)]d kk (14.85) 

k= 1 

where d kk for k = 1, 2,..., N are the diagonal elements of D. 

Now if 

q r (n)(D - A r DA)q(n) > 0 (14.86) 

and signals v k (n) are quantized such that 

\v k (n)\ < \v k (n)\ for k = 1,2,..., N (14.87) 

then Eq. (14.85) yields 

Ap[q(n)] < 0 (14.88) 

that is, the power stored in the unit delays cannot increase. Since a digital filter is a finite-state 
machine, signals q k (n) must after a finite number of filter cycles either become permanently zero 
or oscillate periodically. In the first case, there are no limit cycle oscillations. In the second case, 
at least one qk(n), say <?/(«), must oscillate periodically. However, from Eq. (14.88), we conclude 
that the amplitude of the oscillation must decrease with each filter cycle by some fixed amount until 
qi(n) becomes permanently zero after a finite number of filter cycles. Therefore, Eq. (14.86) and the 
conditions in Eq. (14.87) constitute a sufficient set of conditions for the elimination of limit cycles. 
A realization satisfying Eq. (14.86) is said to support the elimination of zero-input limit cycles. 
The conditions in Eq. (14.87) can be imposed by quantizing the state variables using magnitude 
truncation. 

For a stable filter, the magnitudes of the eigenvalues of A are less than unity and Eq. (14.86) is 
satisfied if a positive definite diagonal matrix D can be found such that matrix D — A ' DA is positive 
semidefinite [27, 28]. For second-order filters, this condition is satisfied if 

012021 > 0 (14.89a) 

or 

012021 < 0 and |an — a 2 i\ + det (A) < 1 (14.89b) 

There are quite a few realizations that support the elimination of zero-input limit cycles. Some 
examples are: normal state-space structures in which 
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with p > 0 [29-31]; realizations that minimize the output roundoff noise such as those in [15, 17] 
(see Sec. 14.7); and lattice realizations [28, 31, 32]. 


Example 14.6 


The structure shown in Fig. 14.16 realizes the biquadratic transfer function 


where 


H(z) = 


Z 2 + a iz + a 0 
Z 2 + b\z + b 0 


c/ifn + 1 ) 


-<+>- 


at = — (oq + a 2 ) 

(14.90a) 

ao = 1 + a\ — a 2 

(14.90b) 

b\ = —(/Si + f} 2 ) 

(14.90c) 

bo = 1 + Pi ~ Pi 

(14.90d) 

qM) 



—® ®-~ 


A 


x(n ) o- 


_r® 


H+> 


3-> 


°—( 3 ) ( 3 )—° ^ 

-© — 


q 2 (n+ 1) 


« 2 (”) 


-o y(n) 


Figure 14.16 Biquadratic realization due to Meerkotter. 
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and is due to Meerkotter [26]. Show that the structure supports the elimination of zero-input 
limit cycles. 


■ Solution 


Straightforward analysis gives the state-space characterization of the structure as 

q (n + 1) = Aq(n) + b.v(n) 
y(n) — c r q(n) + dx(n) 


where 


a n 

an 


Pi 

00! + D' 

a 2 \ 

a 22 


(Pi — 1) 

Pi 


(Pi - oq) 

(P 2 - Q!2) 



and d = 1 


The filter is stable if and only if 


1 - b 0 > 0 
1 + b\ + b 0 > 0 

1 - £>i + bo > 0 


(14.91a) 

(14.91b) 

(14.91c) 


as can be easily shown by using the Jury-Marden stability criterion (see Sec. 5.3.7. From 
Eq. (14.90), we can show that 

a 12 a 2l = (Pi + 1X/02 - 1) = i [b\ - (1 + b 0 ) 2 ] 

and since 1 + i>o > b u according to Eq. (14.91c), we conclude that ai 2 « 2 i < 0. Hence, 
zero-input limit cycles can be eliminated by using magnitude truncation only if the 
condition in Eq. (14.89b) is satisfied. Simple manipulation now yields 

|an - « 22 l + det (A) = \b 0 - 1| + b 0 - 1 + 1 = 1 

since bo — 1 is negative according to Eq. (14.91a); that is, Eq. (14.89b) is satisfied with 
the equal sign and, therefore, the structure supports the elimination of zero-input limit 
cycles. ■ 


Limit cycles can also be generated if the input assumes a constant value for a certain period of 
time. Limit cycles of this type, which include zero-input limit cycles as a special case, are referred 
to as constant-input limit cycles ; they can be eliminated by using techniques described by Verkroost 
[33], Turner [34], and Diniz and Antoniou [35]. A state-space realization of the transfer function 
in Eq. (14.65) that supports the elimination of zero- and constant-input limit cycles is illustrated in 
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Figure 14.17 Second-order state-space realization that supports the elimination of zero- and constant-input 
limit cycles. 


Fig. 14.17, where 

«11 = fl 22 = — / 3 l /2 

012 = —«21 = Ot, 

Vi+Yo _ (2 + Pi)yo - (j6i + 2j6 0 )Ki 

Cl ~ 1 + Ji + fa Cl ~ 2af(l + ^i+A)) 

d = 8 



Constant a can be used to achieve optimal scaling. This structure is optimal or nearly optimal with 
respect to roundoff noise and is, in addition, slightly more economical than the state-space realization 
given by Eqs. (14.66a)-(14.66f) (see [35] for more details). 


(14.92a) 

(14.92b) 

(14.92c) 

(14.92d) 


14.9.4 Elimination of Overflow Limit Cycles 

Overflow limit cycles can be avoided to a large extent by applying strict scaling rules, e.g., using 
scaling method A in Sec. 14.6.1, to as far as possible prevent overflow from occurring. The problem 
with this approach is that signal levels throughout the filter are low; as a result, a poor signal-to-noise 
ratio is achieved. The preferred solution is to allow overflow on occasion but prevent the limit-cycle 
oscillations from occurring. A solution of this type reported in [22] involves incorporating a saturation 
mechanism in the design of adders so as to achieve a transfer characteristic of the type depicted in 
Fig. 14.14 /t where 

x if |x| < M 

M if |x| > M 


Q[x] = 
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If this type of adder is used in the filter of Example 14.5, output y(n) given in column 3 of 
Table 14.6 will be obtained. Evidently, the overflow limit cycle will be eliminated but a quanti¬ 
zation limit cycle of amplitude 2/64 and frequency 0 will be present. This is due to the fact that this 
amplitude satisfies Eq. (14.77), as can be easily verified. 

A concept that is closely related to overflow oscillations is the stability of the forced response 
of a nonlinear system or filter. If v(n ) and v(n) are the state variables in Fig. 14.15, first with and 
then without the quantizers installed, the forced response of the filter is said to be stable if 

lim [ v{n) — v{n)\ = 0 

n—>o o 

In practical terms, the stability of the forced response implies that transients due to overflow effects 
tend to die out once the cause of the overflow has been removed. 

Claasen, Mecklenbrauker, and Peek [36] have shown that if a filter incorporating certain 
nonlinearities, e.g., overflow nonlinearities, is stable under zero-input conditions, then the forced 
response is also stable with respect to a corresponding set of nonlinearities. On the basis of this 
equivalence, if a digital filter of the type shown in Fig. 14.15 is stable under zero-input conditions, 
i.e., it satisfies Eq. (14.86) subject to the conditions in Eq. (14.87), then the forced response is also 
stable provided that the nonlinearities in Eq. (14.81) satisfy the conditions 

2 — x < Qk[x] < 1 for 1 < x < 3 
—2 — x > Qk[x] > — 1 for — 3 < x < — 1 
-1 < Qk[x] < 1 for | x| > 3 

for k = 1, 2,..., N, as illustrated in Fig. 14.18. 

The stability of the forced response implies freedom from overflow limit cycles. It should be 
mentioned, however, that Claasen et al. deduced the above equivalence on the assumption that there 
is an infinite time separation between successive occurrences of overflow. Consequently, the above 
conditions may not guarantee the absence of overflow limit cycles if overflow occurs while the filter 
is recovering from a previous overflow. 



Figure 14.18 Transfer characteristic that guarantees the stability of the forced response. 
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PROBLEMS 

14.1. (a) Convert the decimal numbers 

730.796875 and - 3521.8828125 

into binary representation. 

(b) Convert the binary numbers 

11011101.011101 and - 100011100.1001101 


into decimal representation. 
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14.2. Deduce the signed-magnitude, one’s-complement, and two’s-complement representations of 

(a) 0.810546875 and ( b ) —0.9462890625. Assume a word length L = 10. 

14.3. The two’s complement of a number x can be designated as 

X = Xo-XiX2 ■ ■ ■ XL 

(a) Show that 

L 

x — — x 0 + x i 2~ i 

i= 1 

(b) Find x if x = 0.1110001011. 

(c) Find x if if = 1.1001110010. 

14.4. Assuming that L = 1 , perform the following operations by using one’s- and two’s-complement additions. 

(a) 0.6015625 - 0.4218750 

(b) -0.359375 + (-0.218750) 

14.5. The two’s complement of x is given by 


(a) Show that 


X = Xq-XiX2 ■ ■ ■ Xl 


Two’s complement (2 l x) 


( 2 l x if jr 0 = 0 

|1 + 2~ 1 T if x 0 = 1 


( b ) Find the two’s complement of 2 4 x if if = 1.00110. 

14.6. (a) The register length in a fixed-point digital-filter implementation is 9 bits (including the sign bit), and 

the arithmetic is of the two’s-complement type. Find the largest and smallest machine-representable 
decimal numbers. 

(b) Show that the addition 0.8125 + 0.65625 will cause overflow. 

(c) Show that the addition 0.8125 + 0.65625 + (—0.890625) will be evaluated correctly despite the 
overflow in the first partial sum. 

14.7. The mantissa and exponent register segments in a floating-point implementation are 8 and 4 bits long, 
respectively. 

(a) Deduce the register contents for —0.0234375, —5.0, 0.359375, and 11.5. 

(b) Determine the dynamic range of the implementation. 

Both mantissa and exponent are stored in signed-magnitude form. 

14.8. A floating-point number 


B 

x = M x 2 e where M = ^ 2~' 

i =1 


is to be stored in a register whose mantissa and exponent segments comprise L + 1 and e + 1 bits, 
respectively. Assuming signed-magnitude representation and quantization by rounding, find the range 
of the quantization error. 

14.9. A filter section is characterized by the transfer function 


H{z) = H 0 


(z + l ) 2 
z 2 + b x z + b 0 


where 


H 0 = -0.01903425 b 0 = 0.8638557 b { = -0.5596596 

(a) Find the quantization error for each coefficient if signed-magnitude fixed-point arithmetic is to be 
used. Assume quantization by truncation and a word length L = 6 bits. 

(b) Repeat part (a) if the quantization is to be by rounding. 
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14.10. (a) Realize the transfer function of Prob. 14.9 by using a canonic structure. 

(b) The biter obtained in part (a) is implemented by using the arithmetic described in Prob. 14.9a. Plot 
the amplitude-response error versus frequency for 10 < a> < 30 rad/s. The sampling frequency is 
100 rad/s. 


(c) Repeat part ( b ), assuming quantization by rounding. 

( d) Compare the results obtained in parts ( b ) and (c). 

14.11. (a) The transfer function 


H(z) = 


z 2 T 2z + 1 
z 2 + b\z + b 0 


where bi = —r */2 


and b 0 = r 2 


is to be realized by using the canonic structure of Fig. 14.7b. Find the sensitivities (z) and 5^ (z). 

(b) The section is to be implemented by using bxed-point arithmetic, and the coefficient quantization 
is to be by rounding. Compute the statistical word length L(a >) for 0.7 < r < 0.95 in steps of 0.05. 
Assume that AA/ max (a>) = 0.02, X\=1 (see Sec. 14.3). 

(c) Plot the statistical word length versus r and discuss the results achieved. 

14.12. (a) Using Tables 14.2 and 14.3, obtain all possible low-sensitivity direct realizations of the transfer 
function in Prob. 14.9. 


(b) The realizations in part (a) are to be implemented in terms of signed-magnitude bxed-point arithmetic 
using a word length L = 6, and quantization is to be by rounding. The sampling frequency is 
100 rad/s. Plot the amplitude-response error versus frequency for 10 < co < 30 rad/s for each 
realization. 


(c) On the basis of the results in part (b), select the least sensitive of the possible realizations. 

( d) Compare the realization selected in part (c) with the canonic realization obtained in Prob. 14.10. 

14.13. The transfer function 


3 

h(z)=h 0 n 

1 = 1 


fa + l ) 2 
z 2 + b u z + b 0i 


where a,, b 0l , and b 1; are given in Table P14.13, represents a lowpass Butterworth biter. 


Table P14.13 


i 

bill 

bu 

i 

2.342170£ - 1 

—9.459200 E - 1 

2 

3.753184£ - 1 

-1.054062 

3 

7.1489541? - 1 

-1.314318 

H 0 

= 5.796931K — 4 



(a) Realize the transfer function using three canonic sections in cascade. 

(b) The realization in part (a) is to be implemented in terms of bxed-point signed-magnitude arithmetic 
using a word length L = 8 bits, and coefficient quantization is to be by rounding. The sampling 
frequency is 10 4 rad/s. Plot the amplitude-response error versus frequency for 0 < a> < 10 3 rad/s. 


14.14. (a) Realize the transfer function in Prob. 14.13 using structure II-2 of Table 14.3. 

(b) The realization in part (a) is to be implemented as in part (b) of Prob. 14.13. Plot the amplitude- 
response error versus frequency for 0 < a> < 10 3 rad/s. 

(c) Compare the realization in part (a) with the cascade canonic realization of Prob. 14.13 with respect 
to sensitivity and the number of arithmetic operations. 


14.15. The response of an A/D converter to a signal x(t) is given by 


y (n) = x(n ) + e(n) 
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where x(n) and e(n) are random variables uniformly distributed in the ranges — 1 < x(n) < 1 and 
_ 2 ~(L+i) <- respectively. 

(a) Find the signal-to-noise ratio. This is defined as 

average signal power 

ri\Tn 1 A 1 O D I 

SNR = 10 log- 

average noise power 

(b) Find the PSD of y(n) if x(n), e(n), x(k), and e(k) are statistically independent. 

14.16. The filter section of Prob. 14.9 is to be scaled using the scheme in Fig. 14.8. 

(a) Find X for scaling. 

(b) Find X for L 2 scaling using a frequency-domain method. 

(c) Find X for L 2 scaling using a time-domain method. (Hint: Use Parceval’s discrete-time formula 
(Theorem 3.11)) 

( d ) Compare the methods in parts ( b ) and (c). 

( e ) Compare the values of X obtained with L^ and L 2 scaling and comment on the advantages and 
disadvantages of the two types of scaling. 

14.17. The canonic realization of Prob. 14.13 is to be scaled according to the scheme in Fig. 14.9 using the Loo 
norm. 

(a) Find the scaling constants Xo, Xi, and X 2 . 

(b) The scaled realization is to be implemented in terms of fixed-point arithmetic and product quanti¬ 
zation is to be by rounding. Plot the relative, output-noise PSD versus frequency. This is defined 
as 


RPSD = 10 log 


S y {e* T ) 

S e {e ia,T ) 


where S y (e J,oT ) is the PSD of output noise and S e (e jwT ) is the PSD of a single noise source. The 
sampling frequency is 10 4 rad/s. 

14.18. Repeat Prob. 14.17 using L 2 scaling and compare the results with those obtained in Prob. 14.17. 

14.19. The low-sensitivity realization of Prob. 14.14 is to be scaled according to the scheme in Fig. 14.9 using 
the L 2 norm. 

(a) Find the scaling constants X 0 , Li, and X 2 . 

(b) The scaled realization is to be implemented in terms of fixed-point arithmetic and product quanti¬ 
zation is to be by rounding. Plot the relative, output-noise PSD versus frequency. 

14.20. The transfer function 


3 


i=i 


a 0 iZ 2 + a u z + doi 
z 2 + buz + b 0i 


where a 0i , a u , b 0i and b i,- are given in Table P14.16 represents a bandstop elliptic filter. 


Table P14.16 


i 

«o, 

a \i 


bin 


bu 


1 

4.623281£ - 1 

7.859900L - 

9 

—7.534381L - 

2 

7.859900 E - 

9 

2 

4.879171L - 1 

5.904108L - 

2 

8.051571L - 

1 

8.883641L - 

1 

3 

1.269926 

— 1.536691L — 

1 

8.051571L - 

1 

—8.883640L - 

1 


(a) Realize the transfer function using three canonic sections in cascade. 

( b ) Determine the scaling constants. Assume the section order implied by the transfer function and use 
Loo scaling. The sampling frequency is 18 rad/s. 

(c) Plot the relative output-noise PSD versus frequency. 
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14.21. 


14.22. 

14.23. 

14.24. 

14.25. 


14.26. 


14.27. 


14.28. 

14.29. 


14.30. 

14.31. 

14.32. 

14.33. 


The transfer function 




a 0i z 2 + a u z + 1 
z 2 + auz + flo/ 


where ao,- and an are given in Table P14.17, represents a digital equalizer. Repeat parts (a) to (c) of 
Prob. 14.16. The sampling frequency is 2.4 jt rad/s. 


Table P14.17 


i 

am 

an 

i 

0.973061 

-1.323711 

2 

0.979157 

-1.316309 

3 

0.981551 

-1.345605 


Demonstrate the validity of Eq. (14.37). 

Show that the column vectors f(z) and g(z) defined in Eq. (14.50) are given by the expressions in 
Eq. (14.51). 

The vector q(n) in the state-space realization {A,b,c r , d ) is subjected to the transformation q(n) = 
Tq(n). 

(a) Show that the transformed realization {A, b, c r , d ) is given by Eq. (14.52.) 

(b) Show that the transformed vectors f(z) and g(z) are given by Eq. (14.53). 

(a) Obtain a state-space section-optimal realization of the lowpass filter in Prob. 14.13. 

(b) Apply L 2 scaling to the realization. 

(c) The scaled realization is to be implemented in terms of fixed-point arithmetic and product quanti¬ 
zation is to be by rounding. Plot the relative, output-noise PSD versus frequency. 

(d) Compare the results with those obtained in the case of the direct canonic realization in Prob. 14.18. 

(a) Apply error-spectrum shaping to the scaled cascade canonic realization obtained in Prob. 11.13. 

( b ) The modified realization is to be implemented in terms of fixed-point arithmetic and product quan¬ 
tization is to be by rounding. Compute and plot the relative output-noise PSD versus frequency 
assuming the L 2 scaling obtained in Prob. 11.18. 

(c) Compare the results with those obtained without error-spectrum shaping in Prob. 11.18. 

A second-order filter characterized by Eq. (14.75) with bi = —1.343503 and b 0 — 0.9025 is to be 
implemented using signed-magnitude decimal arithmetic. Quantization is to be performed by rounding 
each product to the nearest integer, and a> s = 27rrad/s. 

(a) Estimate the peak-to-peak amplitude and frequency of the limit cycle by using Jackson’s approach. 

(b) Determine the actual amplitude and frequency of the limit cycle by simulation. 

(c) Compare the results obtained in parts (a) and (b). 

Repeat Prob. 14.27 for the coefficients b\ = —1.8 and b 0 = 0.99. 

A second-order filter represented by Eq. (14.75) is implemented in terms of fixed-point decimal arith¬ 
metic. 

(a) Show that the filter can sustain zero-input limit cycles of amplitude yo (yo > 0) and frequency 0 or 
a> s /2 if Eq. (14.77) is satisfied. 

(b) Find y 0 if bi = -1.375 and b 0 = 0.625. 

The second-order realization shown in Fig. 4.5c can under certain conditions support the elimination of 
zero-input limit cycles. Deduce these conditions. 

Show that the state-space realization of Eqs. (14.92a)-(14.92d) supports the elimination of zero-input 
limit cycles. 

Realize the lowpass filter of Prob. 14.13 using Meerkotter’s structure shown in Fig. 14.16. 

Design a sinusoidal oscillator by using a digital filter in cascade with a bandpass filter. The frequency 
of oscillation is required to be ca s / 10. 
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15 


DESIGN OF 
NONRECURSIVE 
FILTERS USING 
OPTIMIZATION 
METHODS 


15.1 INTRODUCTION 

The window method for the design of nonrecursive filters described in Chap. 9 is based on a closed- 
form solution and, as a result, it is easy to apply and entails a relatively insignificant amount of 
computation. Unfortunately, it usually leads to suboptimal designs whereby the filter order required 
to satisfy a set of given specifications is not the lowest that can be achieved. Consequently, the 
number of arithmetic operations required per output sample is not minimum, and the computational 
efficiency and speed of operation of the filter are not as high as could be. 

This chapter deals with a method for the design of nonrecursive filters known as the weighted- 
Chebyshev method. In this method, an error function is formulated for the desired filter in terms of a 
linear combination of cosine functions and is then minimized by using a very efficient multivariable 
optimization algorithm known as the Remez exchange algorithm. When convergence is achieved, 
the error function becomes equiripple as in other types of Chebyshev solutions (see Sec. 10.4). The 
amplitude of the error in different frequency bands of interest is controlled by applying weighting to 
the error function. 

The weighted-Chebyshev method is very flexible and can be used to obtain optimal solutions 
for most types of nonrecursive filters, e.g., digital differentiators, Hilbert transformers, and lowpass. 
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highpass, bandpass, bandstop, and multiband filters with piecewise-constant amplitude responses. 
Furthermore, like the methods of Chaps. 12 and 16, it can be used to design filters with arbitrary 
amplitude responses. In common with other optimization methods, the weighted-Chebyshev method 
requires a large amount of computation; however, as the cost of computation is becoming progres¬ 
sively cheaper and cheaper with time, this disadvantage is not a very serious one. 

The development of the weighted-Chebyshev method began with a paper by Flerrmann published 
in 1970 [1], which was followed soon after by a paper by Hofstetter, Oppenheim, and Siegel [2], 
These contributions were followed by a series of papers, during the seventies, by Parks, McClellan, 
Rabiner, and Flerrmann [3-8]. These developments led, in turn, to the well-known McClellan-Parks- 
Rabiner computer program for the design of nonrecursive filters, documented in [9], which has found 
widespread applications. The approach to weighted-Chebyshev filters presented in this chapter is 
based on that reported in Refs. [3, 6, 8], and includes several enhancements proposed by the author 
in Refs. [10, 11]. 

15.2 PROBLEM FORMULATION 

Consider a nonrecursive filter characterized by the transfer function 

IV—1 

H{ z ) = Y J h{nT)zr n 

n =0 

and assume that N is odd, the impulse response is symmetrical, and a> s 
s, the frequency response of the filter can be expressed as 


05.1) 

= 2jt. Since T = 2n/a) s — 1 


H(e ja,T ) = e~ jcw P c (co ) 


where 

C 

Pc(<0) = E cos ka> (15.2) 

it=o 

flo = h(c) 

ak — 2h(c — k) for k = 1, 2, ... , c 
c=(N - l)/2 


(see Table 9.1). 

If e~^ CM D(u>) is the desired frequency response and W(o>) is a weighting function, an error 
function E(co) can be constructed as 

E(co) = W((o)[D(co) - P c (a >)] (15.3) 


If | E ( co) | is minimized such that 


\E{(o)\ < S p 
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with respect to some compact subset of the frequency interval [0, jr], say, f2, a filter can be obtained 
in which 


|£o(®)l = I D(co) - P c (co )| < for co e ft 

\W(cd)\ 


(15.4) 


15.2.1 Lowpass and Highpass Filters 

The amplitude response of an equiripple lowpass filter is of the form illustrated in Fig. 15.1, where 
S p and S a are the amplitudes of the passband and stopband ripples, and a> p and <o„ are the passband 
and stopband edges, respectively. Hence, we require 


with 


D(<d) = 


for 0 < co < co p 

for CO a < CO < TT 


|£o(«)| < 



for 0 < tn < co p 
for co a < co < TT 


Therefore, from Eqs. (15.4) and (15.5b), we can deduce the weighting function as 


(15.5a) 


(15.5b) 


W(co) = 


1 

Sp/S a 


for 0 < a> < o) p 
for co a < co < TC 


Similarly, for highpass filters, we obtain 


D(w) = 


for 0 < a> < co a 

fora>p<a><7T 


(15.6) 



Figure 15.1 Amplitude response of an equiripple lowpass filter. 
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and 


W(oj) = 


&p/$a 

1 


for 0 < co < w a 
for CD p < CD < 7T 


(15.7) 


15.2.2 Bandpass and Bandstop Filters 

The amplitude responses of equiripple bandpass and bandstop filters assume the forms illustrated in 
Fig. 15.2a and b, respectively, where S p and S a are the passband and stopband ripples, respectively. 



(a) 



Figure 15.2 Amplitude responses of equiripple filters: (a) Bandpass filter, ( b) bandstop filter. 
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co p i and w p 2 are the passband edges, and co„ \ and co a 2 are the stopband edges. For bandpass filters 


and for bandstop filters 


D(co ) = { 1 for co p \ < a> < co p 2 

I 0 for (O a 2 < a> < 7 T 


W{co) = 


D(co) = 


W(co) = 


<5/; A, 

for 0 < W < (l) a i 

1 

for cOpi < o) < cop2 

8 p /8 a 

for (J 0 a 2 < CO < It 

1 

for 0 < co < a>pi 

0 

for (O a \ < (O < U) a 2 

1 

for C0 P 2 < CO < TX 

1 

for 0 < co < (Dpi 

Sp/Sa 

for a> a 1 < a> < w a 2 

1 

for co p 2 < co < 7 T 


(15.8) 


(15.9) 


15.2.3 Alternation Theorem 

An effective approach for the solution of the optimization problem at hand is to solve the minimax 
problem 


minimize {max | E(co) |} 

X CO 


(15.10) 


where 


x = [«o flt • • • «c] r 

The solution of this problem exists by virtue of the so-called alternation theorem [12] which is as 
follows: 

Theorem 15.1 Alternation Theorem If P c (u>) is a linear combination ofr — c + 1 cosine 
functions of the form 


P c (uj) = ak cos ku) 

k =0 

then a necessary and sufficient condition that P c {ui) be the unique, best, weighted-Chebyshev 
approximation to a continuous function I)(ui) on $2, where $2 is a compact subset of the 
frequency interval [0,7r], is that the weighted error function EAui) exhibits at least r + 1 
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extremal frequencies in F2, that is, there must exist at least r + 1 points &,■ in fl such that 

UJQ < U)\ < . . . < Cjy 

E(u>i) = -E(u> i+ 1 ) for i = 0,1, 1 

and 

|£(u>,-)| = max || fori = 0,1, ... , r A 
From the alternation theorem and Eq. (15.3), we can write 

mo = wmwm - p c (&o] = (,-iys (i 5 . 1 i) 

for i = 0, 1, ... , r, where <5 is a constant. This system of equations can be put in matrix form as 


r 1 i 

1 cos &o cos 2&>o • • • cos c^o - 

W{cb Q ) 

1 COS&l COs2&)i ••• COSC&I - 

W(jx>\) 


a 0 

d\ 


D{d) o) 
D(&0 

(-iy 

1 cos &),• cos 2a> r ■ ■ ■ cos c£b r - 

L W(cb r ) J 


d c 

8 


_D{a> r )_ 


If the extremal frequencies (or extremals for short) were known, coefficients a* and, in turn, the 
frequency response of the filter could be computed using Eq. (15.2). The solution of this system of 
equations exists since the above (r + l)x(r+l) matrix is known to be nonsingular [12]. 


15.3 REMEZ EXCHANGE ALGORITHM 

The Remez exchange algorithm is an iterative multivariable algorithm which is naturally suited for 
the solution of the minimax problem in Eq. (15.10). It is based on the second optimization method 
of Remez [13] and involves the following basic steps: 

Algorithm 1: Basic Remez exchange algorithm 

1. Initialize extremals &o, &i, ... , & r and ensure that an extremal is assigned at each band edge. 

2. Locate the frequencies too, a>i, ... , a> p at which |£’(a>)| is maximum and \E{a>i)\ > <5. These fre¬ 
quencies are potential extremals for the next iteration. 

3. Compute the convergence parameter 

max |£'(aS;)| — min \E(a>0\ 

0= - - 1 1 (15.13) 

max \E(aii)\ 

where i — 0, 1 , ... , p. 

4. Reject p — r superfluous potential extremals 5, according to an appropriate rejection criterion and 
renumber the remaining iS, sequentially; then set &,■ = 1 5, for i =0,1, ... , r. 
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5. If Q > s, where s is a convergence tolerance (say e = 0.01), repeat from step 2; otherwise continue 
to step 6. 

6. Compute P c (a >) using the last set of extremals; then deduce h(n), the impulse response of the required 
filter, and stop. • 

The amount of computation required by the algorithm tends to depend quite heavily on the 
initialization scheme used in step 1, the search method used for the location of the maxima of the 
error function in step 2, and the criterion used to reject superfluous frequencies a>, in step 4. 


15.3.1 Initialization of Extremals 


The simplest scheme for the initialization of extremals a>, for i = 0. I. r is to assume that they 

are uniformly spaced in the frequency bands of interest. If there are J distinct bands in the required 
filter of widths B \, B 2 , ... , Bj and extremals are to be located at the left-hand and right-hand band 
edges of each band, the total bandwidth, that is, B\ + B 2 H— ■ + Bj, should be divided into r + 1 — J 
intervals. Under these circumstances, the average interval between adjacent extremals is 


W 0 = 


1 

r + 1 


7 to, 

.7=1 


Since the quantities Bj /Wo need not be integers, the use of Wo for the generation of the extremals will 
almost always result in a fractional interval in each band. This problem can be avoided by rounding 
the number of intervals Bj / Wo to the nearest integer and then readjusting the frequency interval 
for the corresponding band accordingly. This can be achieved by letting the numbers of intervals in 
bands j and J be 


nij — Int 



for j = 1, 2, ... , J — 1 


(15.14a) 


and 


j -1 

mj — r - ^~^{rnj + 1) 

j =1 


(15.14b) 


respectively, and then recalculating the frequency intervals for the various bands as 

W, = ^~ for j = 1,2, ... , / (15.15) 

m j 

A more sophisticated initialization scheme which was found to give good results is described in 
Ref. [14], 


15.3.2 Location of Maxima of the Error Function 

The frequencies which must include maxima at band edges if | E(otj)\ > |<5|, can be located 
by simply evaluating B(co)\ over a dense set of frequencies. A reasonable number of frequency 
points that yields sufficient accuracy in the determination of the frequencies &>, is 8 (N + 1). This 
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corresponds to about 16 frequency points per ripple of | E(oj)\ . A suitable frequency interval for the 
jth band is Wj — Wj /S with S — 16. 

The above exhaustive step-by-step search can be implemented in terms of Algorithm 2 below 
where co^j and co R j are the left-hand and right-hand edges in band j; Wj is the interval between 
adjacent extremals and m 7 is the number of intervals Wj in band j; Wj is the interval between 
successive samples of | E(a>)\ in interval Wj and S is the number of intervals Wj in each interval Wj\ 
Nj is the total number of intervals Wj in band j ; and J is the number of bands. 


Algorithm 2: Exhaustive step-by-step search 

1. Set Nj = nijS, Wj = Bj/Nj, and e = 0. 

2. For each of bands 1,2, ... , j, ... , J do: 

For each of frequencies a>ij = co R j, a> 2 j = co R j + Wj, .... = co R j + (i — l)u> 7 , ... , a>(v 7 +i y — 

co R j , set 5> e = <x>ij and e = e + 1 provided that \E(o)ij)\ > |5| and one of the following conditions 
holds: 

(a) Case <Wy = a> R j\ if |£(a)y)l is maximum at = a> L j (i.e., \E(a>ij)\ > \E(oo L j + e)|); 

(. b ) Case u>ij < a< (Orj: if |E(w)| is maximum at a> = (i.e., \E(a>jj — Wj)\ < |£(a>, 7 )[ > 

\E{a>ij + Wj) |); 

(c) Case a>ij = a>Rj'. if \E(u>ij)\ is maximum at <w,- 7 = cv R j (i.e., |£'(a> S7 )| > \E(co R j — e)|. • 


The parameter e in steps 2(a) and 2(c) is a small positive constant and a value I W 2 W j was found 
to yield satisfactory results. 

In practice, \E(a>)\ is maximum at an interior left-hand band edge 1 if its first derivative at the 
band edge is negative, and a mirror-image situation applies at an interior right-hand band edge. In 
such cases, |£(&>)| has a zero immediately to the right or left of the band edge and the inequality in 
step 2(a) or 2(c) may sometimes fail to identify a maximum. However, the problem can be avoided 
by using the inequality \E(co L j — e)| > \E(a> L j)\ in step 2(a) and \E(co R j)\ < \E(co R j + e)| in step 
2(c) for interior band edges. An alternative approach to the problem is to use gradient information 
based on the formulas given in Sec. 15.6. 

In rare circumstances, a maximum of | E(co) \ may occur between a band edge and the first sample 
point. Such a maximum may be missed by Algorithm 2 but the problem can be easily identified since 
the number of potential extremals will then be less than the minimum. The remedy is to check the 
number of potential extremals at the end of each iteration and if it is found to be less than r + 1, 
the density of sample points, i.e., S , is doubled and the iteration is repeated. If the problem persists, 
the process is repeated until the required number of potential extremals is obtained. If a value of S 
equal to or less than 256 does not resolve the problem, the loss of potential extremals is most likely 
due to some other reason. 

An important precaution in the implementation of the preceding as well as the subsequent search 
methods is to ensure that extremals belong to the dense set of frequency points to avoid numerical 
ill-conditioning in the computation of E(a>) (see Eqs. (15.11) and (15.17)). In addition, the condition 
\E(u>ij)\ > |<51 should be replaced by \E(u>ij)\ > |5| — e\, where £i is a small positive constant, say, 
ICE 6 , to ensure that no maxima are missed owing to roundoff errors. 


l An interior band edge is one in the range 0 < u> < Jt, that is, not at a> = 0 or n. 
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The search method is very reliable and its use in Algorithm 1 leads to a robust algorithm since 
the entire frequency axis is searched using a dense set of frequency points. Its disadvantage is that 
it requires a considerable amount of computation and is, therefore, inefficient. Improved search 
methods will be considered in Sec. 15.4. 

A more efficient version of Algorithm 2 is obtained by maintaining all the interior band edges 
as extremals throughout the optimization independently of the behavior of the error function at the 
band edges. However, the algorithm obtained tends to fail more frequently than Algorithm 2. 

15.3.3 Computation of \E(u>)\ and 1\(uj) 

In steps 2 and 6 of the basic Remez algorithm (Algorithm 1), \E(co)\ and P r (o>) need to be evaluated. 
This can be done by determining coefficients a k by inverting the matrix in Eq. (15.12). This approach 
is inefficient and may be subject to numerical ill-conditioning, in particular, if 8 is small and N is 
large. An alternative and more efficient approach is to deduce S analytically and then interpolate 
P, (oj) on the r frequency points using the barycentric form of the Lagrange interpolation formula. 
The necessary formulation is as follows. 

Parameter S can be deduced as 


ELo a kD(&>k) 

S~^r (-D k a k 
Z^=0 W(a> k ) 


(15.16) 


and P c (co) is given by 


where 


with 


Pc((0) = 


C k 

yv-l 
2-~ik =0 x—x k 

V' r_1 ft 

2-/k=Q x-Xi 


for CO = CO 0 , &>1, . . . , &>r- 1 
otherwise 


(15.17) 


o/k 


C k 


Pk 


n 


(=0, ijik 


1 


Xk - Xi 


D(cb k )-(-l) k 


8 

W(cbk) 


n 


i=0, ijkk 


1 


X k ~ Xi 


(15.18) 

(15.19) 

(15.20) 


x = cos co and x, = cos &),- for i = 0, 1 , 2, ... , r 


In step 2 of the Remez algorithm, lEX&OI often needs to be evaluated at a frequency that was an 
extremal in the previous iteration. For these cases, the magnitude of the error function is simply |<5|, 
according to Eq. (15.11), and need not be evaluated. 
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15.3.4 Rejection of Superfluous Potential Extremals 

The solution of Eq. (15.12) can be obtained only if precisely r + 1 extremals are available. By 
differentiating E(a>), one can show that in a filter with one frequency band of interest (e.g., a digital 
differentiator) the number of maxima in | E (o>) | (potential extremals in step 2 of Algorithm 1) is r +1. 
In the weighted-Chebyshev method, band edges at which | £■(&>) | is maximum and |£(<u)| > |<5| are 
treated as potential extremals (see Algorithm 2). Therefore, whenever the number of frequency bands 
is increased by one, the number of potential extremals is increased by 2, that is, for a filter with J 
bands there can be as many as r + 2J — 1 frequencies o>, and a maximum of 2/ — 2 superfluous &>, 
may occur. This problem is overcome by rejecting p — r of the potential extremals if p > r, in 
step 4 of the algorithm. 

A simple rejection scheme is to reject the p — r frequencies &>,■ that yield the lowest E(o>,)\ 
and then renumber the remaining &>,■ from 0 to r [8]. This strategy is based on the well-known fact 
that the magnitude of the error in a given band is inversely related to the density of extremals in that 
band, i.e., a low density of extremals results in a large error and a high density results in a small error. 
Conversely, a low band error is indicative of a high density of extremals, and rejecting superfluous 
coi in such a band is the appropriate course of action. 

A problem with the above scheme is that whenever a frequency remains an extremal in two 
successive iterations, \E{cS)\ assumes the value of |51 in the second iteration by virtue ofEq. (15.11). 
In practice, there are almost always several frequencies that remain extremals from one iteration to 
the next, and the value of | E(co)\ at these frequencies will be the same. Consequently, the rejection of 
potential extremals on the basis of the magnitude of the error can become arbitrary and may lead to the 
rejection of potential extremals in bands where the density of extremals is low. This tends to increase 
the number of iterations, and it may even prevent the algorithm from converging on occasion. This 
problem can to some extent be alleviated by rejecting only potential extremals that are not band edges. 

An alternative rejection scheme based on the above strategy, which was found to give excellent 
results for 2-band and 3-band filters, involves ranking the frequency bands in the order of lowest 
average band error, dropping the band with the highest average error from the list, and then rejecting 
potential extremals, one per band, in a cyclic manner starting with the band with the lowest average 
error [11], The steps involved are as follows: 

Algorithm 3: Alternative rejection scheme for superfluous potential extremals 

1. Compute the average band errors 

Ej = - l £ ( s «)l for y = 1,2, ... ,7 

V j ~ 

COi ef lj 

where is the set of potential extremals in band j given by 

= {<«, : o) L] < ", < u R j) 

vj is the number of potential extremals in band j, and J is the number of bands. 

2. Rank the J bands in the order of lowest average error and let l \, I 2 , ... , lj be the ranked list obtained, 
i.e., 1 1 and lj are the bands with the lowest and highest average error, respectively. 

3. Reject one in each of bands l lt l 2 , ... , lj-i, h, ( 2 , • • • until p — r superfluous co, are rejected. In 
each case, reject the a> ; , other than a band edge, that yields the lowest \E(cOj)\ in the band. • 
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For example, if J = 3, p — r = 3, and the average errors for bands 1, 2, and 3 are 0.05, 0.08, 
and 0.02, then a>, are rejected in bands 3, 1, and 3. Note that potential extremals are not rejected in 
band 2, which is the band of highest average error. 

15.3.5 Computation of Impulse Response 

The impulse response in step 6 of Algorithm 1 can be determined by noting that function P c (a>) 
is the frequency response of a noncausal version of the required filter. The impulse response of 
this filter, represented by ho(n) for —c<n< c, can be determined by computing P,(kQ) for 
k = 0, 1, 2, ... , c, where = 2 n/N, and then using the inverse discrete Fourier transform. It can 
be shown that 


ho(n) — h 0 (-n ) = 


N 


(2nkn \ 


E / Z.JL Ktl \ 

2P c (k£i) cos ( —-— J 

k =l \ N / 


(15.21) 


for n = 0, 1, 2, ... , c (see Prob. 15.1). Therefore, the impulse response of the required causal filter 
is given by 


h(n) = h()(n — c) 


for n = 0, 1,2, ... , N- 1. 

15.4 IMPROVED SEARCH METHODS 

For a filter of length TV, with the number of intervals Wj in each interval Wj equal to S, the exhaustive 
step-by-step search of Sec. 15.3.2 (Algorithm 2) requires about S x (N + l)/2 function evaluations, 
where each function evaluation entails TV — 1 additions, ( TV + l)/2 multiplications, and ( TV + l)/2 
divisions (see Eq. (15.17)). A Remez optimization usually requires four to eight iterations for lowpass 
or highpass filters, 6 to 10 iterations for bandpass filters, and 8 to 12 iterations for bandstop filters. 
Further, if prescribed specifications are to be achieved and the appropriate value of TV is unknown, 
typically two to four Remez optimizations have to be performed (see Sec. 15.7). For example, if 
TV — 101. S = 16, number of Remez optimizations = 4, iterations per optimization = 6, the 
design would entail 24 iterations, 19,200 function evaluations, 1.92 x 10 6 additions, 0.979 x 10 6 
multiplications, and 0.979 x 10 6 divisions. This is in addition to the computation required for the 
evaluation of <5 and coefficients «/,, C*, and ft. once per iteration. In effect, the amount of computation 
required to complete a design is quite substantial. In this section, alternative search techniques which 
reduce the amount of computation to a fraction of that required by the exhaustive search described 
in the previous section, are described. 

15.4.1 Selective Step-by-Step Search 

When Eq. (15.12) is solved, the error function |£'(&>)| is forced to satisfy the alternation theorem of 
Sec. 15.2.3. This theorem can be satisfied in several ways. The most likely possibility is illustrated 
in Fig. 15.3a, where coij and a>Rj are the left-hand and right-hand edges, respectively, of the yth 
frequency band. In this case, u>Lj and corj are extremal frequencies and there is strict alternation 
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between maxima and zeros of |£(tw)|. Additional maxima of | E(a>)\ can be introduced under the 
following circumstances: 

1. To the right of co = 0 (first band), if there is an extremal and | E(oj)\ has a minimum at co = 0, 
as depicted in Fig. 15.3b (see properties of \P c (co)\ in Sec. 15.6); 

2. To the left of co = it (last band), if there is an extremal and E(co)\ has a minimum at co = n, as 
depicted in Fig. 15.3c (see Sec. 15.6); 

3. At co = 0, if there is no extremal at co = 0, as depicted in Fig. 15.3c/; 

4. At co = n, if there is no extremal at co = jr, as depicted in Fig. 15.3c; 

5. To the right of an interior left-hand edge, as depicted in Fig. 15.3/; 

6. To the left of an interior right-hand edge, as depicted in Fig. 15.3g; 

7. At co = o>i j, if there is no extremal at co = u>Lj, as depicted in Fig. 15.3/;; 

8. At co — co R j, if there is no extremal at co — co R j , as depicted in Fig. 15.3;; 

9. Two consecutive new maxima at the interior of a band between two adjacent extremals, as 
depicted in Fig. 15.3 j. 

The maxima in Fig. 15.3 a can be located by searching in the neighborhood of each extremal 
frequency using gradient information since there is a one-to-one correspondence between extremals 
and maxima of \E(a>)\. If the first derivative is positive (negative), there is a maximum of \E(co)\ to 
the right (left) of the extremal, which can be readily located by increasing (decreasing) the frequency 
in steps Wj until | E(co)\ begins to decrease. The maxima in items (1) and (2) in the above list can 
be found by searching to the right of co = 0 in the first case or to the left of co = n i n the second 
case, if the second derivative is positive at co — 0 or n. Similarly, the maxima in (3) and (4) can be 
identified by checking whether | E(co)\ has a maximum and | E(co)\ > |<5| at co = 0 in the first case or 
at cx> = 7r in the second case. The maxima in (5) and (6) can be found by searching to the right of 
an interior left-hand edge if the first derivative is positive or to the left of a right-hand interior edge 
if the first derivative is negative. Similarly, the maxima in (7) and (8) can be identified by checking 
whether the first derivative is negative at co — colj in the first case and positive at co — co R j in the 
second case, and \E(co)\ > |<$| in each of the two cases. 

If a selective step-by-step search based on the above principles is used in Algorithm 1. then at the 
start of the optimization the distance between a typical extremal o>, and the nearby maximum point o>, 
will be less than half the period of the corresponding ripple of | E(co) |, owing to the relative symmetry 
of the ripples of the error function. In effect, in the first iteration only half of the combined width of the 
different bands needs to be searched. This will reduce the number of function evaluations by more than 
50 percent relative to that required by the exhaustive search of Sec. 15.3.2 without degrading the ac¬ 
curacy of the optimization in any way. As the optimization progresses and the solution is approached, 
extremal co, and maximum point co, tend to coincide and, therefore, the cumulative length of the fre¬ 
quency range that has to be searched is progressively reduced, thereby resulting in further economies 
in the number of function evaluations. In the last iteration, only two or three function evaluations are 
needed (including derivatives) per ripple. As a result, the total number of function evaluations can 
be reduced by 65 to 70 percent relative to that required by the exhaustive search [10]. 

A selective search of the type just described will miss maxima of the type in item (9) of 
the above list and the algorithm will fail. However, the problem can be overcome relatively easily. 
Maxima of the type in (9) can sometimes occur in the stopbands of bandstop filters, and it was found 
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Figure 15.3 Cont’d Types of maxima in \E(a>)\. 
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possible to reduce the number of failures by increasing somewhat the density of extremals in the 
stopband relative to the density of extremals in the passbands [11], An alternative approach, which 
was found to give good results, is to check the distance between adjacent potential extremals at 
the end of the search; if the difference exceeds the initial difference by a significant amount (say if 
— u>k) > RWj for some k, where R is a constant in the range 1.5 to 2.0), then an exhaustive 
search is undertaken between a>^ and co^+i) to locate any missed maxima. 


15.4.2 Cubic Interpolation 

This section deals with yet another search method that can further increase the computational effi¬ 
ciency of the Remez algorithm. The method is based on cubic interpolation [11]. 

Assume that the error function, depicted in Fig. 15.4, can be represented by the third-order 
polynomial 


IFXttOI = M = a + bco + cco 2 + da? (15.22) 

where a, b, c, and d are constants. The first derivative of M with respect to <» is obtained from 
Eq. (15.22) as 


dM 

dot 


— G — b + 2 cco + 3 dor 


Hence, the frequencies at which M has stationary points are given by 

1 r 


co = - c ± \J (c 2 — 3 bd) 

id L 


(15.23) 



Figure 15.4 Frequency points for cubic interpolation. 














688 DIGITAL SIGNAL PROCESSING 


Assuming that d ^ 0, the stationary point that corresponds to a maximum point, designated as a>, 
can be selected by noting that M is maximum when 

dC-M 

-T- =2 c + 6 dco < 0 

dao 1 


or 


c 


co < — 


3d 


(15.24) 


Evidently, if constants b, c, and d are known, o> can be readily determined. If we assume that kb \, 
tt> 2 , and w 3 are distinct frequencies, we can write 


M 


= M k = a + bkb k + c(kb k ) 2 + d(kb k ) 3 

(O—COlc 


for k — 1,2, and 3 and 


G 

= Gi = b + 2ckb\ + 3d(&\) 2 

(D=Q) 1 


By solving this system of simultaneous equations, we can show that 



i= f - y , 

9 — xjf 

(15.25) 


^3 

1 

II 

0 

(15.26) 


b — Gi — 2cft>i — 3d(cb\) 2 

(15.27) 

where 

_ (Mo — Mi) + G\(u>\ — (bo) 

(ftll - tt > 2 ) 2 

(15.28) 


(A /3 — M\) + G j (cb\ — 0 ) 3 ) 

(d>\ - ® 3 ) 2 

(15.29) 


2(d>i) 2 — 002 ( 0)1 + CO 2 ) 

U — 

(kb 1 — (bo) 

(15.30) 

2 (ft;l) , — <W3(ft>i + «3) 

y/ = ----- 

(kb 1 — 0 ) 3 ) 

(15.31) 

By evaluating constants /), y. 6, 1 //, d, c, and b and then using Eqs. (15.23) and (15.24), 

do can be 


determined. 

The search just described entails four function evaluations, three for M\, Mo, M 3 , and one for 
G 1 , per external. The method is useful as a possible replacement of the selective search only if it 
gives a fairly accurate estimate of &>. To achieve this goal, the cubic interpolation should not be used 
near band edges where \E(w)\ is not well behaved (see Fig. 15.3). 
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If the above cubic interpolation is to be used to find the maximum of | E (a>) | in the neighborhood 
of extremal the most suitable value for frequency a>\ is the extremal itself since the value of M 
is known at this frequency and need not be computed. It is given by Eq. (15.11) as 

M \co=&i = l«l 

The frequency u>3 should bracket the required maximum point a>,, that is, |&),j < tu, < dp \. but 
it should not bracket the adjacent zero of the error function. It should be recalled at this point that 
as the solution is approached, w, tends to move closer to <£),-. Therefore, the accuracy of the cubic 
interpolation can be improved by reducing the interval 0)3 — d>\ as the solution is approached. Such 
an adjustable bracket can be formed by using the convergence parameter Q of Eq. (15.13), which 
is known to reduce from 1 to 0 as the solution is approached. A formula for d> 3 , which was found to 
give good results [ 11 ] is 


{ «; + y («/+1 - &>i) for Gj > 0 

q (15-32) 

&>, - —(d>i - &>,■_ 1 ) for Gi < 0 

Frequency S 02 can be placed at the center of the frequency range d:>\ to dp, that is, 

d >2 — \{d> 1 + C 03 ) (15.33) 

The computational efficiency of the cubic-interpolation method described remains constant 
from iteration to iteration since the number of function evaluations required to perform an interpola¬ 
tion is constant. At the start of the optimization, the cubic-interpolation search is more efficient than 
the selective step-by-step method. However, as the solution is approached the number of function 
evaluations required by the selective search is progressively reduced, as was stated earlier, and at 
some point the selective search becomes more efficient. A prudent strategy under these circum¬ 
stances is to use the cubic-interpolation search at the start of the optimization and switch over to the 
selective step-by-step search when some suitable criterion is satisfied. Extensive experimental results 
have shown that computational advantage can be gained by using the cubic-interpolation search if 
Q > 0.65, and the selective search otherwise [11]. The use of the cubic interpolation search along 
with the selective step-by-step search of the preceding section can reduce the number of function 
evaluations by 70 to 75 percent relative to that required by the exhaustive search. 

15.4.3 Quadratic Interpolation 

An alternative method for the location of the maxima of | £■ (a>) | that was found to work well is 
based on a two-stage quadratic interpolation search. However, the computational efficiency that can 
be achieved with this approach was found to be somewhat inferior relative to the above one-stage 
cubic-interpolation search. 

15.4.4 Improved Formulation 

In the problem formulation considered so far, the extremals o>o, a>i, ... ,a> r are treated as a 1-D 
array and are numbered sequentially from 0 to r. Through the rejection of superfluous extremals, as 
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detailed in the previous sections, the distribution of extremals can change from iteration to iteration. 
In order to evaluate S and coefficients C k in Eqs. (15.16) and (15.19) correctly, it is necessary to 
monitor and track the indices of the first and last extremal of each band throughout the optimization. 
This tends to complicate the implementation of the Remez algorithm quite significantly. The problem 
can be eliminated by representing the extremals in terms of a 2-D array of the form 


&12 ••• o>i j ••• d)u 
CO 21 &>22 ■■■ &>2 j ■■■ (02 J 

Ant A*22 • • • (Otiji ■ • • 


where the jth column represents the extremals of the /th band, /i , is the number of extremals in the 
yth band, and J is the number of bands. The use of this notation necessitates that the formulas for S 
and P c (co) be modified accordingly. From Eqs. (15.16)—(15.20) one can show that (see Probs. 15.2 
and 15.3) 


S = 


E 


{k,m}€ K, 


OCkmD (CO/un ) 


E 


(~i) % t „ 
{*,m}€ K, W(tb km ) 


(15.34) 


and 


where 


with 


and 


Ckn. 

Pc(co) = { E 

E 


fcCi. 

{k,m}e K r _i x—x km 


[k,m}€ K r _ 


Jhn 


for co e Cl 
otherwise 


(15.35) 


n 

{*, j}€ Ir-l 


1 

%km %ij 


! fikm 

Pkm 

Xkm X/ijj 


if k = \i j and m = J 
otherwise 


Ckn 


D{w km ) - (-If 


S 

W(oj km ) 


(15.36) 


(15.37) 

(15.38) 


q = 


k- l 

*-i + E7=iV- 


if m — 1 
if m > 2 


(15.39) 


Xij = cos a>ij 


X — COS CO 


for {/, j] e I, 
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In the above formulation, K,, K,._ |, I, , and I r _i are sets given by 


and 


with 


and 


K,. = {{A:, m} : (1 < k < ) and (1 < m < /)} 

K,._! = {{£, m] : (1 < k < l) and (1 < m < /)} 
l = {{i, j\ :(!<'< A ij) and (1 < j < J)) 


l = 


h — 


h) and (1 

< j < J) and (i ^4 k or j ^ m)} 

\ dj ~ 1 

for m — J 

^ /tm 

otherwise 

Uj- 1 

for j = J 

\di 

otherwise 


(15.40) 

(15.41) 

(15.42) 


(15.43) 


15.5 EFFICIENT REMEZ EXCHANGE ALGORITHM 

The above principles will now be used to construct an efficient Remez exchange algorithm. As in 
Algorithm 2, a>Lj and cdrj are the left- and right-hand edges in band j; Wj is the interval between 
adjacent extremals and m , is the number of intervals Wj in band j; Wj is the interval between 
successive samples in interval Wj, and S is the number of intervals Wj in each interval Wj\ Nj 
is the total number of intervals Wj in band /: and J is the number of bands. The frequencies 
u>\j, a> 2 j, ■ ■ ■ , u>iijj are the current extremals and 5>\j, a> 2 j, ... , co Vj j are the potential extremals for 
the next iteration in band j. The magnitude of the error function and its first and second derivatives 
with respect to o> are denoted as 


M = \E(co)\ 


G, = 


d\E(co)\ 

da> 


Gi = 


d 2 \E(a>)\ 

dco 2 


The improved algorithm consists of a main part called MAIN which calls routines EXTRE¬ 
MALS, SELECTIVE, and CUBIC. The steps involved are detailed below. 


Algorithm 4: Efficient Remez exchange algorithm 
MAIN 

Ml. 

(a) Initialize 5, say, S — 16, and set Q = 1. 

(b) For j — 1,2 ./do: 

Compute ni j and Wj for j = 1,2, ... , J using Eqs. (15.14) and (15.15), respectively. 
Initialize extremals by letting = & L j, .... a>y = a> L j + (/ — l)Wj, ... , cb^.j = a>gj= 

(OLj + mjWj. 

Set Nj = nijS and Wj = Bj/Nj. 
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M2. 

(o) Compute coefficients f} k j, a kj , and C k j for j = 1, 2, ... , J using Eqs. (15.36)—(15.38'). 

(b) Compute S using Eq. (15.34). 

M3. Call EXTREMALS. 

M4. 

(a) Set p = vi + v 2 + ... vy- 

(b) Reject p — (r + 1) superfluous potential extremals 2 using Algorithm 3. renumber the remaining 
cbjj sequentially, and update fij if necessary. 

(c) Update extremals by letting <£>y = Sy for i — 1,2, ... , p.j and j = 1,2, ... , J. 

M5. 

(a) Compute Q using Eq. (15.13). 

(. b ) If Q > 0.01, go to step M2. 

M6. 

(a) Compute P c (kQ) for k = 0, 1, ... , r — 1 using Eq. (15.35). 

(b) Compute h(n) using Eq. (15.21). 

(c) Stop. 


EXTREMALS 

El. For each of bands 1,2,... , j, ... , J do: 

(A) Set e = 0. 

(B) For each of extremals <£>i j, & 2 j, ... , o>,y, ... , do: 

(а) Case &>y = cbij: 

If cbij = u> L j , then do: 

Case j = I (first band): 

If Gy < 0, then set e = e + 1 and a> e j = a>y; otherwise call SELECTIVE. 

Case j / 1 (other bands): 

If Gi > 0, then call SELECTIVE; otherwise set e = e + 1 and a> e j = &y. 

If w , 7 ^ ay, then call SELECTIVE. 

( б ) Case &[j < &>ij < cbfijj' 

lfQ< 0.65, then call SELECTIVE; otherwise call CUBIC. 

If//flg 0=1 (CUBIC was unsuccessful in generating a good estimate of the maximum 
point), then call SELECTIVE. 

(c) Case o>,j — 

If cbij = (ORj, then do: 

Case j = J (last band): 

If Gy < 0, then set e = e + 1 and aiy = a>y; otherwise call SELECTIVE. 

Case j ^ J (other bands): 

If G\ < 0, then call SELECTIVE; otherwise set e = e + 1 and wy = <£>y. 

If cbij + a>Rj, then call SELECTIVE. 

(C) Check for an additional potential extremal at the left-hand edge of band j: If and oj\ / 7 ^ 

a>Lj, \E(a> LJ )\ > \E(a>Lj + uij)|, and \E(u>Lj )I > |<51 , then set e = e + 1 and insert new 
potential extremal at co = u>ij. 


2 The difference between the number of superfluous extremals in step 4 of Algorithm 1 and step M4(b) of Algorithm 4 is 
due to the fact that the count of potential extremals starts with 0 in Algorithm 1 and with I in Algorithm 4. 
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(D) Check for an additional potential extremal at the right-hand edge of band j: If tb^.j and 
aj e j 7 ^ a)Rj, \E(ci)Rj — uy)| < \E(to R j)\, and \E(to R j)\ > |<5|, then insert new potential 
extremal at to = eogj and set e = e + 1. 

(E) Check for additional potential extremals in band j: 

(a) For k = 1,2, ... , e — 1 check if 

£>(k+i)j ~ a> kj > R Wj 

For each value of k for which the inequality is satisfied, use an exhaustive search between 
frequencies Sy and £(t+iy (see Algorithm 2). For each new maximum of M such that 
|£(a>)| > |<5|, insert a new potential extremal sequentially between aiy and co ft+ i y and 
set e = e + 1 (R is a constant in the range 1.5 to 2.0). 

( b ) If there is a large gap (larger than R Wj) between the left-hand edge and the first potential 
extremal, check for additional potential extremals in the range a>y < to < aiy-; for 
each new maximum such that |£'(a>)| > |<5|, insert a new potential extremal sequentially 
between ayy and aiy and set e = e + 1 . 

(c) If there is a large gap (larger than R Wj ) between the last potential extremal and the right- 
hand edge, check for additional potential extremals in the range a> e j < to < to R j ; for 
each new maximum such that IFXaOl > |<5|, insert a new potential extremal sequentially 
between to e j and a> R j and set e = e + 1 . 

(F) Set Vj = e. 

E2. Return. 

SELECTIVE 

Sl.If(Gi > 0 and &>ij ^ 0 ) or (G 2 > 0 and = 0 ), then increase to in steps wj until a maximum 
of M is located. Set e = e+ 1 and assign the frequency of this maximum to a> e . If no maximum is located 
in the frequency range ay < to < (<£>(,- + iy or to R j), discontinue the search. 

52. If (G 1 < 0 and <£>,-,■ n) or (G 2 > 0 and ay = 7 r), then decrease to in steps Wj until 
a maximum of M is located. Set e = e + 1 and assign the frequency of this maximum to to e . If no 
maximum is located in the frequency range (a>y or d> (; _ iy) < to < tbjj, discontinue the search. 

53. Return. 

CUBIC 

Cl. Set flagO = 0. 

C2. Set tb\ = &>ij and compute frequencies ay and a ) 2 using Eqs. (15.32) and (15.33). 

C3. Compute constants fi, y, 6, and t/t using Eqs. (15.28)—(15.31). 

C4. Compute constants d, c, and£>usingEqs.(15.25)-(15.27).If3M > c 1 (third-order polynomial 
has no maximum), then set flag 0 = 1 and return. 

C5. Compute to using Eqs. (15.23) and (15.24). If frequency to is outside the interval [ay, ay] 
(estimate of the maximum point is unreliable), then set flag 0 = 1 and return. 

C 6 . Set to = Wj x Int ( to/wj + 0.5). 

C7. Set e = e + 1 and to e j — to. 

C 8 . Return. • 

Step El (B)(a) checks for maxima at or near the left-hand edge of each band for the cases 
illustrated in Fig. 15.3a, b, d, f, and h. Step El (B)(b) locates the interior maxima in Fig. 15.3a that 
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correspond to extremals d> 2 j to Step El (B)(c) checks for maxima at or near the right- 

hand edge of each band for the cases illustrated in Fig. 15.3 a, c, e, g, and i. Step E1(C) checks 
for a new maximum at left-hand edge colj in the special case where there is no extremal and a 
maximum has not been picked up already at this frequency by step El(B)(a). Such a situation 
can arise as shown in Fig. 15.3d where step El (B)(a) will pick up the maximum at the right of 
point co = 6) | j , since Gi > 0, but miss the maximum at co — 0. A similar situation can arise 
as illustrated in Fig. 15.3/z. Step E1(D) checks for a new maximum at right-hand edge co R] for 
the case where there is no extremal and a maximum has not been picked up already at this frequency 
by step ElfB)(c). Such a situation can arise as shown in Fig. 15.3e where step EI (B)(c) will pick up 
the maximum at the left of point co= & ;i , j , since Gi<0, but miss the maximum at co—jt. A similar 
situation can arise as illustrated in Fig. 15.3L Steps El (£)(«) to El(£)(c) check for any missed max¬ 
ima, like the maxima between to \ ; and u>2j in Fig. 15.3 j, in cases where the interval between any two 
adjacent maxima, between the left-hand edge and the first maximum, or between the last maximum 
and the right-hand edge is significantly larger than the average interval between adjacent extremals. 

When the ripple of the error function is seriously skewed (e.g., near band edges in the first 
or second iteration) routine CUBIC may yield a poor estimate of the maximum point, and on rare 
occasions the third-order polynomial may not have a maximum. If either of these cases is detected, 
CUBIC is aborted and SELECTIVE is called in its place. CUBIC will almost always yield a value of 
oo between two adjacent sample points. In order to ensure that each potential extremal is a member 
of the set of sample points, to is rounded to the nearest sample point in step C 6 . This makes the esti¬ 
mate produced by CUBIC compatible with that produced by SELECTIVE and prevents numerical 
ill-conditioning in the evaluation of E(co), G \, and G 2 . The CUBIC interpolation routine may be 
disabled by modifying step El (B)(b). 

Extensive experimentation by the author has shown the above algorithm to be quite robust. 
It never failed in the design of 81 2-band filters chosen at random, it failed twice in the design of 
67 3-band filters, three times in the design of 50 4-band filters, and three times in the design of 33 
5-band filters. Lack of convergence is usually brought about by a cyclic pattern of rejected potential 
extremals, but the problem can be easily overcome by changing one of the specified filter parameters 
slightly, e.g., a passband or stopband edge or the order of the filter. 


15.6 GRADIENT INFORMATION 

Routines SELECTIVE and CUBIC in the above algorithm rely heavily on the first and second 
derivatives of \E{co)\ with respect to 00 . From Eq. (15.3), we have 


and 


d\E{co)\ 

dco 


= sgn [D(co) - P c (co)] 


dD(co) 

dco 


dP c (co) 

dco 


(15.44) 


d 2 1E (co) | 
dco 2 


= sgn [D(oj) - P c (co )] 


d 2 D(co) 

dco 2 


d 2 P c (co) 

dco 2 


(15.45) 


where 


sgn (x) = 


1 

-1 


for a' > 0 
for x < 0. 
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The first and second derivatives of \E(co)\ under different circumstances can be obtained from the 
following properties of |P c (<y)| [10]. 



15.6.2 Property 2 

For all extremal frequencies except co IXj j, 

dP c ((o) 
du> 

where 

K|/_, = {{A:, /«} : (1 < k < l) and (1 < m < J ) and (k ^ i or m ^ j)} 

with 

Hi — 1 for m — J 

l±m otherwise 

15.6.3 Property 3 

For co — 0 or it, it follows from properties 1 and 2 that 

dP c {co) _ Q 
dco 



sin (con) 


{it, m)eK[ J _, 


fikiii ( Pi j Ck m ) 

%ij Xkm 


(15.47) 


(15.48) 
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15.6.4 Property 4 

For m — 0 if no extremal occurs at zero or for co — it under all circumstances, 


where 


d 2 P c (m) d(co)ii 2 {co) — d 2 (co)n(co) 


dm 2 


d 2 {m) 


n 2 (m) = cosoi 


(t,m|eK r _ 


d 2 (m) = cos m 




k km k m 

(x - X km ) 2 

fikm 

(x - x km ) 2 


(15.49) 


15.6.5 Property 5 

If there is an extremal at m = 0, then 


d 2 P c (m) 
dm 2 


= — V 

9=0 Bn ^ 

H {k, mJeKjij 


11 Ckm) 

X %km 


(15.50) 


where K^j = with i = j = 1. 


Example 15.1 


Design a nonrecursive equiripple highpass filter using the Remez algorithm 
(i a ) with the exhaustive search of Sec. 15.3.2, ( b ) with the selective step-by-step search of 
Sec. 15.4.1, and (c) with the selective step-by-step search in conjunction with the cubic- 
interpolation search of Sec. 15.4.2. Compare the results obtained. The required specifications 
are as follows: 


• Filter length N : 21 

• Passband edge m p : 2.0 rad/s 

• Stopband edge m a : 1.0 rad/s 

• Ratio S p /S a : 18.0 

• Sampling frequency m s : 2 jt rad/s 


■ Solution 

The design in ( a ) was carried out using Algorithm 1 in conjunction with Algorithms 2 
and 3, whereas the designs in ( b ) and (c) were carried out using Algorithm 4, first without 
and then with routine CUBIC, respectively. The progress of the design is illustrated in 
Table 15.1. As can be seen, the exhaustive and selective search methods required four iter¬ 
ations each, whereas the selective search in conjunction with cubic interpolation required 
five iterations. However, the number of function evaluations (evaluations of P c (m) using 
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Table 15.1 Progress in design of highpass filter 
(Example 15.1) 


Iter. No. Exhaustive Selective Sel. with cub. 


search search interpolation 



Q 

FE’s 

Q 

FE’s 

Q 

FE’s 

1 

0.9379 

154 

0.9379 

70 

0.9379 

49 

2 

0.5792 

154 

0.5792 

48 

0.6519 

28 

3 

0.0846 

154 

0.0846 

29 

0.0756 

28 

4 

0.0000 

154 

0.0000 

20 

0.0309 

22 

5 

— 

— 

— 

— 

0.0000 

20 

Total FE’s 


616 


167 


147 


Eq. (15.35) plus evaluations of G\ and G 2 using Eqs. (15.44) and (15.45), respectively) 
decreased from 616 in the first method to 167 in the second and to 147 in the third. In the 
Remez algorithm, approximately 80 to 90 percent of the computational effort involves 
function evaluations. In effect, relative to that required by the exhaustive search, the 
use of the selective step-by-step search reduced the amount of computation by about 
73 percent, and the use of the selective step-by-step search in conjunction with the 
cubic-interpolation search reduced the amount of computation by about 76 percent. 

The three methods resulted in approximately the same impulse responses, as can be 
seen in Table 15.2, and the passband ripple and minimum stopband attenuation obtained 
in each case were 0.073 dB and 72.6 dB, respectively. The amplitude response of the 
filter is illustrated in Fig. 15.5. ■ 

Table 15.2 Impulse response of highpass filter 
(Example 15.1) 


n ho(n ) = /io(— n) 

Exhaustive or selective Selective with cubic 


search interpolation 


0 

4.976192E 

- 1 

4.976160E 

- 1 

1 

—3.120628E 

- 1 

-3.120636E 

- 1 

2 

2.462999E 

-3 

2.466692E 

- 3 

3 

8.853907E 

-2 

8.854032E 

-2 

4 

—2.605336E 

-3 

-2.609410E 

- 3 

5 

—3.790087 E 

-2 

—3.790082 E 

-2 

6 

2.553469 E 

-3 

2.555600 E 

-3 

7 

1.553835 E 

-2 

1.553849E 

-2 

8 

-2.126568E 

-3 

—2.127674E 

- 3 

9 

-5.222708 E 

-3 

—5.222820 E 

- 3 

10 

1.898114E 

-3 

1.898558E 

-3 
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Figure 15.5 Amplitude response of equiripple highpass filter (Example 15.1) (the passband 
gain is multiplied by the factor 200 to show the passband ripple). 


Example 15.2 


Design a nonrecursive equiripple bandpass filter using the Remez algorithm 
(i a ) with the exhaustive search, ( b ) with the selective step-by-step search, and ( c ) with the 
selective step-by-step search in conjunction with the cubic-interpolation search. Compare the 
results obtained. The required specifications are as follows: 


• Filter length N: 33 

• Lower passband edge co p i: 1.00 rad/s 

• Upper passband edge a> p 2 : 2.00 rad/s 

• Lower stopband edge co a \: 0.63 rad/s 

• Upper stopband edge co a 2 : 2.40 rad/s 

• Ratio S p /S a : 23.0 

• Sampling frequency u > s : 2 j r rad/s 


■ Solution 

As in Example 15.1, the design in (a) was earned out using Algorithm 1 in conjunc¬ 
tion with Algorithms 2 and 3, whereas the designs in ( b ) and (c) were carried out 
using Algorithm 4 first without and then with routine CUBIC. The progress of the de¬ 
sign is illustrated in Table 15.3. In this example, each of the three methods required 
eight iterations, and in each case there was a superfluous maximum at the end of the 
fourth iteration. The problem was eliminated by rejecting the second maximum of the 
third band, using the rejection method detailed in Sec. 15.3.4 (see Algorithm 3). As can 
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Table 15.3 Progress in design of bandpass filter 
(Example 15.2) 


Iter. No. 

Exhaustive 

search 

Selective 

search 

Selective with cubic 
interpolation 


Q 

FE’s 

Q 

FE’s 

Q 

FE’s 

1 

0.8970 

231 

0.8970 

99 

0.8906 

42 

2 

0.6109 

231 

0.6109 

63 

0.6098 

42 

3 

0.4556 

231 

0.4556 

54 

0.3940 

59 

4 

0.2975 

231 

0.2975 

W 23 rejected 

40 

0.2924 

41 

5 

0.6329 

231 

0.6329 

45 

0.6342 

45 

6 

0.4035 

231 

0.4035 

44 

0.4019 

44 

7 

0.1268 

231 

0.1268 

40 

0.1293 

40 

8 

0.0063 

231 

0.0063 

32 

0.0078 

32 

Total FE’s 


1848 


417 


345 


be seen in Table 15.3, the number of function evaluations decreased from 1848 in the 
first method to 417 in the second method to 345 in the third method. In effect, the use 
of the selective step-by-step search reduced the amount of computation by about 77 
percent, and the use of the selective step-by-step search in conjunction with the cubic- 
interpolation search reduced the amount of computation by about 81 percent, relative to 
that required by the exhaustive search. 

The three methods resulted in approximately the same impulse responses, as can 
be seen in Table 15.4. The amplitude response of the filter is illustrated in Fig. 15.6; 



Figure 15.6 Amplitude response of equiripple bandpass filter (Example 15.2) (the passband 
gain is multiplied by the factor 20 to show the passband ripple). 
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the passband ripple and minimum stopband attenuation obtained in each case were 
0.934 dB and 52.6 dB, respectively. ■ 


Table 15.4 Impulse response of bandpass filter 
(Example 15.2) 


n 

h 0 (n) — h 0 (- 

-n) 



Exhaustive or selective 
search 

Selective with cubic 
interpolation 

0 

4.095939E 

- 1 

4.095922E - 

1 

1 

2.529508E 

-2 

2.529615E- 

2 

2 

-2.978313E 

- 1 

-2.978309E - 

1 

3 

-3.828648E 

-2 

-3.828785E - 

2 

4 

7.734350E 

-2 

7.734476E - 

2 

5 

— 1.885007E 

- 3 

-1.885265E- 

3 

6 

5.491991E 

-2 

5.491921E- 

2 

7 

3.246312E 

-2 

3.246380E - 

2 

8 

-4.740273E 

-2 

-4.740238E - 

2 

9 

—1.517104 E 

-2 

— 1.5172571s — 

2 

10 

—4.296619E 

- 3 

—4.2947201s - 

3 

11 

—1.645571£ 

-2 

-1.645695 E- 

2 

12 

2.126770E 

-2 

2.126169E — 

2 

13 

2.137354E 

-2 

2.1374821s — 

2 

14 

—8.758516E 

- 3 

—8.7604081s - 

3 

15 

—8.493829E 

- 3 

—8.4924781s - 

3 

16 

-3.891420E 

-5 

-3.931393 E- 

5 


15.7 PRESCRIBED SPECIFICATIONS 

Given a filter length N ., a set of passband and stopband edges, and a ratio 8 p /S a , a nonrecursive filter 
with approximately piecewise-constant amplitude-response specifications can be readily designed. 
While the filter obtained will have passband and stopband edges at the correct locations and the ratio 
8p/8 a will be as required, the amplitudes of the passband and stopband ripples are highly unlikely 
to be precisely as specified. An acceptable design can be obtained by predicting the value of N on 
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the basis of the required specifications and then designing filters for increasing or decreasing values 
of N until the lowest value of N that satisfies the specifications is found. 

A reasonably accurate empirical formula for the prediction of N for the case of lowpass and 
highpass filters, due to Herrmann, Rabiner, and Chan [15], is 



(15.51) 


where 


B = \(o a - M p \/2n 

D = [0.005309(log 8 p f + 0.07114 log S p - 0.4761] log S a 


— [0.00266(log S p f + 0.5941 log S p + 0.4278] 
F = 0.51244(log S p — log S a ) + 11.012 


This formula can also be used to predict the filter length in the design of bandpass, bandstop, and 
multiband filters in general. In these filters, a value of N is computed for each transition band between 
a passband and stopband or a stopband and passband using Eq. (15.51) and the largest value of N 
so obtained is taken to be the predicted filter length. Prescribed specifications can be achieved by 
using the following design algorithm: 

Algorithm 5: Design of filters satisfying prescribed specifications 

1. Compute N using Eq. (15.51); if N is even, set N = N + 1. 

2. Design a filter of length N using Algorithm 4 and determine the minimum value of S, say S. 

(A) If <5 > S p , then do: 

(a) Set N = N + 2, design a filter of length N using Algorithm 4, and find S ; 

( b ) If 8 < S p , then go to step 3; else, go to step 2(A)(a). 

(B) If 5 < S p , then do: 

(a) Set N = N — 2, design a filter of length N using Algorithm 4, and find <5; 

( b ) If <5 > S p , then go to step 4; else, go to step 2 (B)(a). 

3. Use the last set of extremals and the corresponding value of N to obtain the impulse response of the 
required filter and stop. 

4. Use the last but one set of extremals and the corresponding value of N to obtain the impulse response 
of the required filter and stop. • 



In an application, a nonrecursive equiripple bandstop filter is required, which 
should satisfy the following specifications: 


• Odd filter length 

• Maximum passband ripple A p : 0.5 dB 

• Minimum stopband attenuation A a : 50.0 dB 
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• Lower passband edge a> p \: 0.8 rad/s 

• Upper passband edge u> P 2 : 2.2 rad/s 

• Lower stopband edge u> a \: 1.2 rad/s 

• Upper stopband edge tt > a 2 : 1.8 rad/s 

• Sampling frequency u> s : 2: r rad/s 

Design the lowest-order filter that will satisfy the specifications. 


■ Solution 


The use of Algorithm 4 in conjunction with Algorithm 5 gave a filter of length 35. The 
progress of the design is illustrated in Table 15.5. The impulse response of the filter 
obtained is given in Table 15.6. The corresponding amplitude response is depicted in 
Fig. 15.7; the passband ripple and minimum stopband attenuation achieved are 0.4342 
and 51.23 dB, respectively, and are within the specified limits. ■ 


Table 15.5 Progress in design of bandstop filter 
(Example 15.3) 


N 

Iters. 

FE’s 

A p , dB 

A a , dB 

31 

10 

582 

0.5055 

49.91 

33 

7 

376 

0.5037 

49.94 

35 

9 

545 

0.4342 

51.23 


Table 15.6 Impulse response of bandstop filter 
(Example 15.3) 

n 

/i 0 (n) = h 0 (—n) 

n 

h 0 (n) = h 0 (—n) 

0 

6.606345 E - 1 

9 

2.806340 E - 2 

1 

—2.307038E - 2 

10 

-2.276572E - 2 

2 

2.711461 £ - 1 

11 

-9.924812E - 3 

3 

4.306831E-2 

12 

-1.047638E - 3 

4 

—1.198723 £ - 1 

13 

— 1.412229E — 2 

5 

— 1.829974E — 2 

14 

1.284774E — 2 

6 

—4.974998E - 3 

15 

1.096745E — 2 

7 

—2.016415E — 2 

16 

8.260758E - 4 

8 

4.593774E - 2 

17 

3.482212E - 3 
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Figure 15.7 Amplitude response of equiripple bandstop filter (Example 15.3) (the passband 
gain is multiplied by the factor 40 to show the passband ripple). 


15.8 GENERALIZATION 

As was demonstrated in Chap. 9, there are four types of constant-delay nonrecursive filters. The 
impulse response can be symmetrical or antisymmetrical, and the filter length can be odd or even. In 
the preceding sections, we considered the design of filters with symmetrical impulse response and 
odd length. In this section, we show that the Remez algorithm can also be applied for the design of 
the three other types of filters. 

15.8.1 Antisymmetrical Impulse Response and Odd Filter Length 

Assuming that co s — 2 tc , the frequency response of a nonrecursive filter with an tisymmetrical impulse 
response and odd length can be expressed as 

H{e jtoT ) = e~ icu, jP' c (a>) 

where 

C 

p'M >) = ak sin ka> (15.52) 

A-l 

ak = 2hie — k ) for k = 1,2, ... , c 

c = (N — l)/2 


(see Table 9.1). 
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A filter with a desired frequency response e ]C0 ‘ j D(o>) can be designed by constructing the 
error function 


E(co) = - P' c {to)\ (15.53) 

and then minimizing |£(&>)| with respect to some compact subset of the frequency interval [0, tt ]. 
From Eq. (15.52), P' c {co ) can be expressed as [6] 

P' c (a j) = sinw P c _i(®) (15.54) 


where 


C— 1 

Pc- iM = E Ck cos ka> 

k =o 


and 


a\ = cq — jC2 

a k = \{c k -\ ~ c k + 1 ) for k = 2,3, ... , c — 2 
a c —j — 2 C c —2 

a c — 2 ^ c— l 

Hence Eq. (15.53) can be put in the form 

E(co) = W{co)[D{(o) - P(co)\ 


(15.55a) 


(15.55b) 

(15.55c) 

(15.55d) 

(15.55e) 


(15.56) 


where 


W{w) = Q(co)W(w) 
D(co) = D(a>)/Q(a>) 
P(a>) = P c _ i(w) 
Q(co) — sino> 


Evidently, Eq. (15.56) is of the same form as Eq. (15.3), and on proceeding as in Sec. 15.2 one can 
obtain the system of equations 

r 1 

1 COS&O COS2&0 • ■ ■ cos(c — 1)&0 —- 

W(a> 0 ) 

-1 

1 cos &>\ COS 2u>\ ■ ■ ■ COS (c — l)ft)l —- 

W(a>\) 

(~i y 

r W(&r) 


ClQ 


D(cb 0 ) 

a i 


D(& i) 

a c - 1 

8 




1 coscb r cos2o),. • • • cos (c — 1 )d>. 
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where r = c is the number of cosine functions in P c -\ (op. This system of equations is the same as 
that in Eq. (15.12) except that the number of extremals has been reduced from c+2 to c+1; therefore, 
the application of the Remez algorithm follows the methodology detailed in Secs. 15.2 and 15.3. 

The use of Algorithm 1 or 4 yields the optimum P c _ \ (o>) and from Eq. (15.54), the cosine 
function P'.(o>) can be formed. Now j P' c (cS) is the frequency response of a noncausal version of the 
required filter. The impulse response of this filter can be obtained as 



(15.57) 


for n = 0, 1, 2, ... , c, where = 2 jt/N, by using the inverse discrete Fourier transform. The 
impulse response of the corresponding causal filter is given by 


h(n ) = ho(n — c) 


for n = 0, 1,2, ... , N - 1. 

15.8.2 Even Filter Length 

The frequency response of a filter with symmetrical impulse response and even length is given by 

H(e Jo,T ) = e- JCW P d (aj) 


where 



k= 1 


b k = 2h(d-k) for k = 1,2, ... ,d 

d = N/2 


(see Table 9.1). Pd(co) can be expressed as 



where 


d -1 



(15.58a) 


Jfc=0 


and 


bk = -(&*-1 + b k ) 
b d = \b d -1 


b\ = b 0 + \b\ 

1 - 


(15.58b) 


for k — 2, 3, ... , d — 


(15.58c) 


(15.58d) 
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Proceeding as in the case of antisymmetrical impulse response, an error function of the form given 
in Eq. (15.56) can be constructed with 

P(fi>) = Pd- i(<w) 


and 

co 

Q(co) = cos - 

Similarly, if the impulse response is antisymmetrical and the filter length is even, we have 

H(e jmT ) = e~ jc< ° j P' d {w) 


where 


d 

P'dico) = y ^b k sin (k - \)co 

k=l 

bk = 2h{d — k) for k = 1, 2, ... , d 
d = N/2 


P d (a>) can now be expressed as 


where 


co 


P' d {co) = sin - P d -\(co) 


d -1 

Pd~ i (<w) = ^ dk cos ken 

k=0 


and 


b\ = do — \d\ 

b k = \{d k -1 — dk) for k = 2, 3, ... , d — 1 
bd = \dd -l 


(15.59a) 


(15.59b) 

(15.59c) 

(15.59d) 


As in the previous case, an error function of the form given in Eq. (15.56) can be obtained with 

P(co) = Pd-xi.co) 

and 

co 

Q(co) = sin - 

The various polynomials for the four types of nonrecursive filters are summarized in 
Table 15.7. 
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Table 15.7 Functions H(e ju}T ), Q(uj), and Piuo) for the various 
types of nonrecursive filters 


h(ri) 

N 

H(ei wT ) 

Q(ui) 

P(w) 

Symmetrical 

odd 

e-i™P c {co) 

1 

PA.O)) = 0 °k cos kco 


even 

e-i cm P d (a>) 

Pd(a>) = J2k =1 b kCos (k - J)® 

COS J 

P<;^l(co) = J2kZo h cos kco 

Antisymmetrical 

odd 

e~t cto jP'ffji) 

= J2k =1 Oksinkai 

sin co 

P c -l(a>) = 121=0 cos ka> 


even 

e~i ca> j P' d (cn) 

P'dico) = Y?k= l b k sin (k - i)w 

. co 
sin — 

2 

Pd-l(o>) = Y2k2 0 cos ka> 

a 0 = h(c) a k 

bk = 2 h(d — k) 

= 2h(c 
d = 

-k) c = (N — l)/2 

N/2 




15.9 DIGITAL DIFFERENTIATORS 

The Remez algorithm can be easily applied for the design of equiripple digital differentiators. The 
ideal frequency response of a causal differentiator is of the form e~j ca> j Dim) where 

D{co ) = co for 0 < \co\ < tt (15.60) 

and c = (N — l)/2 (see Sec. 9.5). From Table 15.7, we note that differentiators can be designed in 
terms of filters with antisymmetrical impulse response of either odd or even length. 

15.9.1 Problem Formulation 

Assuming odd filter length, Eqs. (15.53) and (15.60) give the error function 
E(co) — W(co)[co — P/(co)] for 0 < co < co p 

where co p is the required bandwidth. Constant absolute or relative error may be required, depending 
on the application at hand. Hence W(co) can be chosen to be either unity or 1 /co. In the latter case, 
E{co) can be expressed as 


E(eo) = 


1 - -P» 

co 


for 0 < co < co p 


and from Eq. (15.54) 


sin&> 

- P c -i(co) for 0 < co < co p 

co 


E(co) = 1 - 


(15.61) 
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Therefore, the error function can be expressed as in Eq. (15.56) with 


W(co) = 


1 

Txco) 


sinoi 


co 


P(co) = P c -i(co ) 


15.9.2 First Derivative 

In Algorithm 4, the first derivative of |£(&>)| with respect to co is required. From Eq. (15.61), one can 
show that 


d\E(a>)\ 

dco 


sgn 


sino) 


i 

X 

CO 



smw — co cos cu 


Pc-\(v) 


sinoi dP c _\(co) 
co dco 


(15.62) 


The first derivative of P c _\(co) can be computed by using the formulas in Sec. 15.6, except that the 
number of extremals is reduced from c + 2 to c + 1. The value of P c _1 (co) can be computed by using 
Eq. (15.35) with c replaced by c — 1. If is an extremal, then Eq. (15.61) yields 


p c -im = [l-c-iya]^- 

sin cot 


since £(&, ) = (—1)'S. 

In Algorithm 4, the second derivative of |£(&>)| with respect to co is used to determine whether 
there is a maximum or minimum at co = 0. For differentiators, this information is more easily 
determined by computing the quantity 


G' 2 = \E( Wl )\ - |£(0)| 

where w\ is the interval between successive samples. Depending on whether G\ is positive or 
negative, | E(co) | has a minimum or maximum at co = 0. 

15.9.3 Prescribed Specifications 

A digital differentiator is fully specified by the constraint 

\E(co)\ < S p for 0 < co < co p 

where S p is the maximum passband error and co p is the bandwidth of the differentiator. 

The differentiator length N that will just satisfy the required specifications is not normally 
known a priori and, although it may be determined on a hit and miss basis, a large number of designs 
may need to be carried out. In filters with approximately piecewise-constant amplitude responses, 
N can be predicted using the empirical formula of Eq. (15.51). In the case of differentiators, N 
can be predicted by noting a useful property of digital differentiators. If S and <5i are the maximum 
passband errors in differentiators of lengths N and A/j, respectively, then the quantity ln(<5/<5i) is 













In (S/S,) 
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approximately linear with respect to /V — /V, for a wide range of values of N\ and a> p , as illustrated 
in Fig. 15.8. Assuming linearity, we can show that [16] 

In (5/5,) 

N = Ni+ V 1J (N 2 - NO (15.63) 

In (<$ 2 /<5 i) 

where <5 2 is the maximum passband error in a differentiator of length /Vi. 

N- JV, 



Figure 15.8 Variation of in (S/SO versus N — V, for different values of a> p and V, = 11. 
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By designing two low-order differentiators, a fairly accurate prediction of the required value 
of N can be obtained by using Eq. (15.63). A design algorithm based on this formula is as follows: 

Algorithm 6: Design of digital differentiators satisfying prescribed specifications 

1. Design a differentiator of length N i, and find Si. 

2. Design a differentiator of length N 2 = Ah + 2 and find S 2 . 

3. If 8 2 < S p < 81 , go to step 7. 

4. SetiS = 8 p and compute N using Eq. (15.63); set 1V 3 = Int (A/+0.5); if N 3 is even and a differentiator 
of odd length is required, then set IV 3 = N 3 + 1 . 

5. Design a differentiator of length N 3 and find S 3 . 

(A) If c $3 > 8 p , then do: 

(a) Set IV 3 = IV 3 + 2, design a differentiator of length N 3 , and find <5 3 ; 

(b) If 8 3 < 8 p , then go to step 6 ; else, go to step 5(A)(a). 

( B ) If 8 3 < 8 p , then do: 

(a) Set N 3 = N 3 — 2, design a differentiator of length N 3 , and find < 53 ; 

(a) If 83 > 8 P , then go to step 7; else, go to step 5 (B)(a). 

6. Use the last set of extremals and the corresponding value of N to obtain the impulse response of the 
required differentiator and stop. 

7. Use the last but one set of extremals and the corresponding value of N to obtain the impulse response 
of the required differentiator and stop. • 


Example 15.4 


In an application, a digital differentiator is required which should satisfy the 
following specifications: 

• Odd differentiator length 


• Bandwidth co p : 2.5 rad/s 

• Maximum passband ripple 8 p : 1.0 x 10 6 

• Sampling frequency u> s : 2jt rad/s 

Design the lowest-order differentiator that will satisfy the specifications. 


■ Solution 

The design was carried out using Algorithm 6 in conjunction with Algorithm 4; in Al¬ 
gorithm 4 the relative error of Eq. (15.61) was minimized. The progress of the design is 
illustrated in Table 15.8. First, differentiators of lengths 21 and 23 were designed and the 


Table 15.8 Progress in design of digital 
(differentiator Example 15.4) 


N 

Iters. 

FE’s 

Sp 


21 

4 

141 

7.649E - 

4 

23 

5 

187 

3.786 E - 

4 

43 

5 

616 

4.078E - 

7 

41 

6 

538 

8.069E - 

7 

39 

6 

500 

1.582E- 

6 
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required N to satisfy the specifications was predicted to be 43 using Eq. (15.63). This 
differentiator length was found to oversatisfy the specifications, and designs for lengths 
41 and 39 were then carried out. The design for N — 39 violates the specifications, 
as can be seen in Table 15.8; therefore, the optimum differentiator length is 41. The 
impulse response of this differentiator is given in Table 15.9. The amplitude response 
and passband relative error of the differentiator are plotted in Fig. 15.9 a and b. m 



(«) 



(b) 

Figure 15.9 Design of digital differentiator (Example 15.4): (a) Amplitude response, 
(, b ) passband relative error. 
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Table 15.9 Impulse response of digital differentiator 
(Example 15.4) 


n 

h 0 (n) = -h 0 (- 

n ) 

n 

h 0 (n) = -h 0 (- 

n ) 

0 

0.0 


ii 

-1.305326£ - 

2 

1 

-9.852395£ - 

1 

12 

7.955151 - 

3 

2 

4.710789£ - 

1 

13 

-4.626299£ - 

3 

3 

-2.914014£ - 

1 

14 

2.544983£ - 

3 

4 

1.966634£ - 

1 

15 

—1.309224£ - 

3 

5 

—1.371947£ - 

1 

16 

6.197315£ - 

4 

6 

9.651420£- 

2 

17 

—2.633737£ - 

4 

7 

-6.751749£- 

2 

18 

9.638584£ - 

5 

8 

4.653727£ - 

2 

19 

-2.795288£ - 

5 

9 

—3.138375E- 

2 

20 

4.916591£ - 

6 

10 

2.058332£ - 

2 





15.10 ARBITRARY AMPLITUDE RESPONSES 

Very frequently nonrecursive filters are required whose amplitude responses cannot be described by 
analytical functions. For example, in the design of two-dimensional filters (see Sec. 18.6) through the 
singular-value decomposition [17, 18], the required two-dimensional filter is obtained by designing 
a set of one-dimensional digital filters whose amplitude responses turn out to have arbitrary shapes. 
In these applications, the desired amplitude response D(co) is specified in terms of a table that lists a 
prescribed set of frequencies and the corresponding values of the required filter gain. Filters of this 
class can be readily designed by employing some interpolation scheme that can be used to evaluate 
D(o>) and its first derivative with respect to co at any to. A suitable scheme is to fit a set of third-order 
polynomials to the prescribed amplitude response. An interpolation scheme of this type is used in 
the design of recursive filters in the next chapter and is described in detail in Sec. 16.6. 


15.11 MULTIBAND FILTERS 

The algorithms presented in the previous sections can also be used to design multiband filters. While 
there is no theoretical upper limit on the number of bands, in practice, the design tends to become 
more and more difficult as the number of bands is increased. The reason is that the difference between 
the number of possible maxima in the error function and the number of extremals increases linearly 
with the number of bands, e.g., if the number of bands is 8, then the difference is 14 (see Sec. 15.3.4). 
As a consequence, the number of potential extremals that need to be rejected is large and the available 
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rejection techniques become somewhat inefficient. The end result is that the number of iterations is 
increased quite significantly, and convergence is slow and sometimes impossible. 

In mathematical terms, the problem discussed in the previous paragraph is attributed to the fact 
that, in the weighted-Chebyshev methods considered in this chapter, the approximating polynomial 
becomes seriously underdetermined if the number of bands exceeds three. The problem can be 
overcome by using the generalized Remez method described in Ref. [14]. This method is based on 
a different formulation of the design problem and leads to three types of equiripple filters, namely, 
maximal-ripple, extra-ripple, and weighted-Chebyshev filters. In the case of maximal-ripple filters, 
the approximating polynomial is fully determined; in the extra-ripple case, it is less underdetermined 
than the approximating polynomial in the methods described. Therefore, for filters with more than 
five bands, the method in Ref. [14] is preferred. 


Example 15.5 


In an application, a nonrecursive equiripple 5-band filter is 
should satisfy the specifications in Table 15.10. The sampling frequency is 
lowest-order filter that will satisfy the specifications. 


required which 
2tc . Design the 


Table 15.10 Specifications of 5-band filter 
(Example 15.5) 


Band: 

1 

2 

3 

4 

5 

D(aj) 

1.00 

0.00 

1.00 

0.00 

1.00 

A p , dB 

0.50 

— 

0.75 

— 

1.00 

A a , dB 

— 

50.00 

— 

30.00 

— 

o>l , rad/s 

0.00 

0.80 

1.50 

2.10 

2.80 

to R , rad/s 

0.60 

1.25 

1.90 

2.60 

7t 


■ Solution 

The use of Algorithm 4 in conjunction with Algorithm 5 gave a filter of length 61. The 
progress of the design is illustrated in Table 15.11. The impulse response of the filter 
obtained is given in Table 15.12, and the corresponding amplitude response is plotted in 
Fig. 15.10. As can be seen, the required specifications are satisfied. ■ 


Table 15.11 Progress in design of 5-band filter 
(Example 15.5) 


N 

Iters. 

FE’s 

A p i, dB 

A a 2 , dB 

Api, dB 

A a 4 . dB 

A p s, dB 

61 

9 

913 

0.453 

50.46 

0.679 

30.86 

0.905 

59 

19 

2219 

0.539 

49.35 

0.808 

29.35 

1.077 
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Table 15.12 Impulse response of 5-band filter 
(Example 15.5) 


n 

h 0 (n) = h 0 (- 

-n ) 

n 

h 0 (n) = h 0 (- 

-«) 

0 

5.608208 E 

- 1 

16 

-8.164458E 

-4 

1 

4.013174E 

- 2 

17 

-3.884179E 

-4 

2 

1.006767 E 

- 1 

18 

2.625242£ 

-3 

3 

4.198731E 

- 2 

19 

—1.130791 Zs 

-2 

4 

2.414087E 

- 1 

20 

9.190432E 

-3 

5 

-1.248415E 

- 1 

21 

8.761118E 

-3 

6 

-1.019101E 

- 1 

22 

6.476604E 

-3 

7 

6.608448E 

- 3 

23 

9.610168E 

-3 

8 

—1.355327Z? 

- 2 

24 

-1.976094E 

-2 

9 

4.780217E 

- 3 

25 

— 1.075689E 

-2 

10 

-1.549769E 

- 2 

26 

3.013727 E 

-3 

11 

3.468520E 

- 2 

27 

-2.707701 E 

-3 

12 

-8.299265 E 

-4 

28 

-2.549441 E 

-3 

13 

4.694733 E 

- 2 

29 

-9.605488E 

-3 

14 

2.641761E 

- 3 

30 

1.495353E 

-2 

15 

-5.336269 E 

- 2 

- 

- 




io , rad/s 

Figure 15.10 Amplitude response of equiripple 5-band filter (Example 15.5) (the passband 
gain is multiplied by the factor 10 to show the passband ripple). 
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The required filter order for multiband filters can be predicted by using the formula in 

Eq. (15.51), as was stated earlier. A generalized version of this formula, which gives improved 

results, can be found in Ref. [14]. 
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PROBLEMS 

15.1. A noncausal nonrecursive filter has a frequency response P c (co). The filter has a symmetrical impulse 
response represented by h 0 (n) for —c<n<c, where c = (IV — l)/2. Using the inverse discrete Fourier 
transform, show that the impulse response of the filter is given by Eq. (15.21). 

15.2. Show that S and P c (co) given by Eqs. (15.16) and (15.17) can be expressed as in Eqs. (15.34) and (15.35), 
respectively. 

15.3. Show that coefficients fi km , a km , and C km , which are used to compute S and P c (co), can be expressed as 
in Eqs. (15.36)—(15.38). 

15.4. Write a computer program based on the Remez algorithm (Algorithm 1) that can be used for the design 
of filters. Use the exhaustive step-by-step search method in Algorithm 2 in conjunction with the scheme 
in Algorithm 3 for the rejection of superfluous potential extremals. Then use a routine that will reject 
the p — r superfluous potential extremals <S, on the basis of the lowest error |£(a>,)| (see Sec. 15.3.4) 
as an alternative rejection scheme and check whether there is a change in the computational efficiency 
of the program. 

15.5. Show that for any frequency including the last extremal of the last band but excluding all other extremals, 
the first derivative of P, (co) with respect to co is given by the formula in Eq. (15.46). 

15.6. Show that for all extremals other than the last extremal of the last band, the first derivative of P c (co) with 
respect to co is given by the formula in Eq. (15.47). 

15.7. Show that the first derivative of P c (co) with respect to co is zero at co = 0 and co = n (see Eq. (15.48)). 
Hence show that \E(co)\ has a local maximum or minimum at these frequencies. 

15.8. Show that for co = 0 if no extremal occurs at zero or for co = 7r under all circumstances, the second 
derivative of P c (co) with respect to co is given by Eq. (15.49). 

15.9. Show that if there is an extremal at co = 0, then the second derivative of P c (co) with respect to co at co = 0 
is given by Eq. (15.50). 

15.10. Write a computer program based on the Remez algorithm that can be used for the design of filters. Use 
the selective step-by-step search method of Sec. 15.4.1. 

15.11. The cubic-interpolation search of Sec. 15.4.2 requires the evaluation of constants d, c, b, f), y, 6, and i/r 
given by Eqs. (15.25)—(15.31). Derive the formulas for these constants. 

15.12. Modify the program of Prob. 15.10 to include the cubic-interpolation search of Sec. 15.4.2 (see Algorithm 
4). 

15.13. Design a nonrecursive equiripple lowpass filter using the Remez algorithm (a) with the exhaustive 
search of Sec. 15.3.2, (b) with the selective step-by-step search of Sec. 15.4.1, and (c) with the selective 
step-by-step search in conjunction with the cubic-interpolation search of Sec. 15.4.2. Compare the 


DESIGN OF NONRECURSIVE FILTERS USING OPTIMIZATION METHODS 717 


results obtained. The required specifications are as follows: 

• Filter length IV: 21 

• Pas sband edge a> p \ 1.0 rad/s 

• Stopband edge a> a : 1.5 rad/s 

• Ratio S p /S a : 18.0 

• Sampling frequency co s : 2n rad/s 

15.14. Design a nonrecursive equiripple bandstop filter using the Remez algorithm (a) with the exhaustive 
search, (b) with the selective step-by-step search, and (c) with the selective step-by-step search in con¬ 
junction with the cubic-interpolation search. Compare the results obtained. The required specifications 
are as follows: 

• Filter length N: 33 

• Lower passband edge w p \: 0.8 rad/s 

• Upper passband edge oj P 2 : 2.1 rad/s 

• Lower stopband edge a> a \. 1.2 rad/s 

• Upper stopband edge a> a 2 '. 1.8 rad/s 

• Ratio S p /S a \ 23.0 

• Sampling frequency co s \ 2n rad/s 

15.15. Modify the program in Prob. 15.10 to include an option for the design of filters satisfying prescribed 
specifications. Use Algorithm 5. 

15.16. In an application, a nonrecursive equiripple highpass filter is required, which should satisfy the following 
specifications: 

• Odd filter length 

• Maximum passband ripple A p : 0.1 dB 

• Minimum stopband attenuation A a : 50.0 dB 

• Passband edge ai p \ 1.8 rad/s 

• Stopband edge io a : 1.0 rad/s 

• Sampling frequency co s \ 2n rad/s 

Design the lowest-order filter that will satisfy the specifications. 

15.17. In an application, a nonrecursive equiripple bandpass filter is required, which should satisfy the following 
specifications: 

• Odd filter length 

• Maximum passband ripple A p : 0.1 dB 

• Minimum stopband attenuation A a : 60.0 dB 

• Lower passband edge a > pl : 1.0 rad/s 

• Upper passband edge oj P 2 : 1.6 rad/s 

• Lower stopband edge m a \: 0.6 rad/s 

• Upper stopband edge ti) a2 : 2.0 rad/s 

• Sampling frequency co s \ 2n rad/s 

Design the lowest-order filter that will satisfy the specifications. 

15.18. Show that the sine polynomial P' c (cl>) of Eq. (15.52) can be expressed as in Eq. (15.54) where P c _ l (a>) 
is given by Eq. (15.55a). 

15.19. A noncausal nonrecursive filter has a frequency response j P c (a>). The filter has an antisymmetrical 
impulse response represented by h 0 (n) for — c < n < c, where c = (N — l)/2. Using the inverse 
discrete Fourier transform, show that the impulse response of the filter is given by Eq. (15.57). 

15.20. The relative error in the design of digital differentiators is given by Eq. (15.61). Show that the first 
derivative of \E{oi)\ with respect to in is given by Eq. (15.62). 
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15.21. Write a computer program based on the Remez algorithm that can be used for the design of digital 
differentiators. Use the selective step-by-step search method in conjunction with the cubic-interpolation 
search. 

15.22. Using the program in Prob. 15.21, design a digital differentiator of length N — 41 and bandwidth 
dtp = 3.0 rad/s. The sampling frequency is 2tc rad/s. 

15.23. If 8 and c5i are the maximum passband errors in digital differentiators of lengths N and Ni, respectively, 
then the quantity In (5/5j) is approximately linear with respect to N — Ni, as can be seen in Fig. 15.8. 
Assuming linearity, derive the prediction formula of Eq. (15.63). 

15.24. Modify the program in Prob. 15.21 to include an option for the design of digital differentiators satisfying 
prescribed specifications. Use Algorithm 6. 

15.25. In an application, a digital differentiator is required, which should satisfy the following specifications: 

• Odd differentiator length 

• Bandwidth d) p : 2.75 rad/s 

• Maximum passband ripple 8 p : 1.0 x 10~ 4 

• Sampling frequency o) s : 2?r rad/s 

Design the lowest-order differentiator that will satisfy the specifications. 

15.26. In an application, a nonrecursive equiripple 4-band filter is required, which should satisfy the specifica¬ 
tions in Table P15.26. The sampling frequency is 2n. Design the lowest-order filter that will satisfy the 
specifications. 


Table P15.26 


Band: 

1 

2 

3 

4 

D(w) 

0.0 

1.0 

0.0 

1.0 

A p , dB 

— 

0.1 

— 

0.4 

A a , dB 

50.0 

— 

55.0 

— 

coi, rad/s 

0.0 

1.2 

2.0 

2.8 

cor , rad/s 

0.8 

1.6 

2.4 

7T 


15.27. In an application, a nonrecursive equiripple 5-band filter is required, which should satisfy the specifi¬ 
cations in Table P15.27. The sampling frequency is a> s = 2n. Design the lowest-order filter that will 
satisfy the specifications. 

Table P15.27 


Band: 

1 

2 

3 

4 

5 

D(co) 

1.0 

0.0 

1.0 

0.0 

1.0 

A p , dB 

0.8 

— 

0.4 

— 

1.0 

A a , dB 

— 

50.0 

— 

30.0 

— 

co L , rad/s 

0.0 

0.8 

1.6 

2.2 

2.9 

(Dj), rad/s 

0.4 

1.2 

1.9 

2.6 

7r 
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RECURSIVE 
FILTERS USING 
OPTIMIZATION 
METHODS 


16.1 INTRODUCTION 

In Chaps. 11 and 12, several methods for the solution of the approximation problem in recursive 
filters have been described. These methods lead to a complete description of the transfer function in 
closed form, either in terms of its zeros and poles or its coefficients. They are, as a consequence, very 
efficient and lead to very precise designs. Their main disadvantage is that they are applicable only 
for the design of filters with piecewise-constant amplitude responses, i.e., biters whose passband and 
stopband gains are constant and zero, respectively, to within prescribed tolerances. 

An alternative approach for the solution of the approximation problem in digital biters is 
through the application of optimization methods [1-5]. In these methods, a discrete-time transfer 
function is assumed and an error function is formulated on the basis of some desired amplitude and/or 
phase response. A norm of the error function is then minimized with respect to the transfer-function 
coefficients. As the value of the norm approaches zero, the resulting amplitude or phase response 
approaches the desired amplitude or phase response. These methods are iterative and, as a result, they 
usually involve a large amount of computation. However, unlike the closed-form methods of Chaps. 
11 and 12, they are suitable for the design of biters having arbitrary amplitude or phase responses. 
Furthermore, they often yield superior designs. 
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In this chapter, the application of optimization methods for the design of recursive digital filters 
is considered. The chapter begins with an introductory section that deals with the formulation of the 
design problem as an optimization problem, and then proceeds with fairly detailed descriptions of 
algorithms that can be used to solve the optimization problem. The algorithms presented are based on 
the so-called quasi-Newton method which has been explored by Davidon, Fletcher, Powell, Broyden, 
and others. The exposition of the material begins with algorithms that are primarily of conceptual 
value and gradually proceeds to algorithms of increasing complexity and scope. It concludes with 
some highly sophisticated algorithms that are practical, flexible, efficient, and reliable. Throughout 
the chapter, emphasis is placed on the application of the algorithms rather than their theoretical 
foundation and convergence properties. Readers who are interested in a more mathematical treatment 
of the subject may consult one of the standard textbooks on optimization theory and practice [6-10]. 


16.2 PROBLEM FORMULATION 

Assume that the amplitude response of a recursive filter is required to approach some specified 
amplitude response as closely as possible. Such a filter can be designed in two general steps, as 
follows: 


1. An objective function which is dependent on the difference between the actual and specified 
amplitude response is formulated. 

2. The objective function obtained is minimized with respect to the transfer-function coefficients. 


An Mh-order recursive filter with N even can be represented by the transfer function 


j 

H(z) = H 0 n 
j =i 


aoj + aijZ + z 2 
b 0j + b\jz + z 2 


06.1) 


where aij and bjj are real coefficients, J = N/ 2, and Hq is a positive multiplier constant. The 
amplitude response of the filter can be expressed as 

M(x, co) — \H(e^ 0>T )\ (16.2) 


where 


x = [aoi ail boi b ii ■ • • b\j Hq] t 

is a column vector with 4/ + 1 elements and co is the frequency. 

Let be the specified amplitude response and, for the sake of exposition, assume that it 

is piecewise continuous, as illustrated in Fig. 16.1. The difference between M(x, co) and Mq(co) is, 
in effect, the approximation error and can be expressed as 

e(x, co) — M(x, co) — Mq(co) (16.3) 

By sampling e(x, co) at frequencies co \, co 2 ,..., cok, as depicted in Fig. 16.1, the column vector 

E(x) = [ei(x) e 2 (x) ... e K (x)] r 
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can be formed where 


e,(x) = e(x, a)/) 


(16.4) 


for i = 1,2 ,..., K. 

The approximation problem at hand can be solved by finding a point x = x such that 

e, (x) « 0 


for i = 1,2 ,..., K. Assuming that a solution exists, a suitable objective function must first be 
formed which should satisfy a number of fundamental requirements. It should be a scalar quantity, 
and its minimization with respect to x should lead to the minimization of all the elements of E(x) in 
some sense. Further, it is highly desirable that it be differentiable. An objective function satisfying 
these requirements can be defined in terms of the L p norm of E(x) as 


^(x) = L p = ||E(x)|| p = 


^2 i e '( x )i / ’ 


where p is an integer. 

Several special cases of the L p norm are of particular interest. The Li norm, namely, 

K 

L\ = ^|e;(x)| 

1=1 
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is the sum of the magnitudes of the elements of E(x); the L 2 norm given by 


L2 


K 

E 

.1=1 


e;(x)|- 


1/2 


is the well-known Euclidean norm', and L\ is the sum of the squares of the elements of E(x). In the 
case where p — oo and 


E(x) — max |e, (x)| ^ 0 

1 <i<K 


we can write 



Since each of the terms in the above summation is equal to or less than unity, we have 

Loo = L(x) 


(16.5) 


With an objective function available, the required design can be obtained by solving the 
optimization problem 


minimize 'I'(x) (16.6) 

X 

If vp (x) is defined in terms of if, a least-squares solution is obtained; if the L^ norm is used, 
a so-called minimax solution is obtained, since in this case the largest element in E(x) is minimized. 

In digital filters, the magnitude of the largest amplitude-response error is usually required to 
be as small as possible and, therefore, minimax solutions are preferred. 

16.3 NEWTON’S METHOD 

The optimization problem of Eq. (16.6) can be solved by using an unconstrained optimization al¬ 
gorithm. Various classes of these algorithms have been developed in recent years, ranging from 
steepest-descent to conjugate-direction algorithms [6-10]. An important class of optimization al¬ 
gorithms that have been found to be very effective for the design of digital filters is the class of 
quasi-Newton algorithms. These are based on Newton’s method for finding the minimum in quadratic 
convex functions. 1 

Consider a function /(x) of n variables, where x = [xi X 2 ■ ■ ■ x n ] T is a column vector, and let 
6 — [<5| 82 ■ ■ ■ S n ] T be a change in x. If /(x) e C 2 , that is, /(x) has continuous second derivatives. 


l A 


two-variable convex function is one that represents a surface whose shape resembles a punch bowl. 
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its Taylor series at point x + 6 is given by 


f(x+6)= f{x) + J2 

i= 1 


3/ (x) „ 

- Oi 

d.Xj 


. n n 

tEE 


d-fix) 


2 ^ ^ dxidx: 

i=i 7=1 J 


8iSj+o(m 2 2 ) 


(16.7) 


where the remainder o(\ 1 6 \ \ 2 ) approaches zero faster than 11 6 \ | ?. If the remainder is negligible and a 
stationary point exists in the neighborhood of some point x, it can be determined by differentiating 
fix + 6) with respect to elements for k — 1,2and setting the result to zero. From 
Eq. (16.7), we obtain 


dfix + 6) = dm y- a 2 /W = 

3 dx k dxjdx k ' 

for k — 1,2This equation can be expressed in matrix form as 

g = —H<5 (16.8) 


where 


and 


H 


dfix) 


■>-1" 

3xj 3x2 

J 

dx, 

3 7(x) 

3 2 fix) 

d 2 m 

3.Vi 

dx\dx2 

dx'i dx„ 

3 1 fix) 

3 2 fix) 

d 2 fix) 

3x23.fi 

d x\ 

3x2 3 x„ 

d 1 fix) 

$ fix) 

d 2 fix) 

3x„3xi 

3x„3x2 

dx n 


are the gradient vector and Hessian matrix (or simply the gradient and Hessian) of fix), respectively. 
Therefore, the value of 6 that yields the stationary point of f(x) can be obtained from Eq. (16.8) as 


6 = 


H g 


(16.9) 


This equation will give the solution if and only if the following two conditions hold: 


(i) The remainder o(| |£|\\) in Eq. (16.7) can be neglected. 

(ii) The Hessian is nonsingular. 
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If fix) is a quadratic function, its second partial derivatives are constants, i.e., H is a constant 
symmetric matrix, and its third and higher derivatives are zero. Therefore, condition (i) holds. If /(x) 
has a stationary point and the sufficiency conditions for a minimum hold at the stationary point, then 
the Hessian matrix is positive definite and, therefore, nonsingular. Under these circumstances, given 
an arbitrary point x e E", 2 the minimum point can be obtained as x = x + 6 by using Eq. (16.9). 

If /(x) is a general nonquadratic convex function that has a minimum at point x, then in the 
neighborhood | |x — x| I 2 < e the remainder in Eq. (16.7) becomes negligible and the second partial 
derivatives of fix) become approximately constant. As a result, in this domain function fix) behaves 
as if it were a quadratic function and conditions (i) and (ii) are again satisfied. Therefore, for any 
point x such that | |x — x 1 12 < e, the use of Eq. (16.9) will yield an accurate estimate of the minimum 
point. 

If a general function fix) is to be minimized and an arbitrary point x e E" is assumed, condition 
(i) and/or condition (ii) may be violated. If condition (i) is violated, then the use of Eq. (16.9) will not 
give the solution; if condition (ii) is violated, thenEq. (16.9) either has an infinite number of solutions 
or has no solutions at all. These problems can be overcome by using an iterative procedure in which 
the value of the function is progressively reduced by applying a series of corrections to x until a 
point in the neighborhood of the solution is obtained. When the remainder in Eq. (16.7) becomes 
negligible, an accurate estimate of the solution can be obtained by using Eq. (16.9). A suitable 
strategy to achieve this goal is based on the fundamental property that if H is positive definite, then 
H 1 is also positive definite. Furthermore, in such a case it can be shown through the use of the Taylor 
series that the direction pointed by the vector — H~'g of Eq. (16.9), which is known as the Newton 
direction, is a descent direction of fix). As a consequence, if at some initial point x, H is positive 
definite, a reduction can be achieved in fix) by simply applying a correction of the form 8 — ad to x, 
where a is a positive factor and d = — H 1 g. On the other hand, if H is not positive definite, it can be 
forced to become positive definite by means of some algebraic manipulation (e.g., it can be changed 
to the unity matrix) and, as before, a reduction can be achieved in fix). In either case, the largest 
possible reduction in fix) with respect to the direction d can be achieved by choosing variable a 
such that fix + ad) is minimized. This can be done by using one of many available one-dimensional 
minimization algorithms (also known as line searches) [6-10]. Repeating these steps a number of 
times will yield a value of x in the neighborhood of the solution and eventually the solution itself. 
An algorithm based on these principles, known as the Newton algorithm, is as follows: 

Algorithm 1: Basic Newton algorithm 

1. Input x 0 and e. Set k = 0. 

2. Compute the gradient g A . and Hessian H A . If H A , is not positive definite, force it to become positive 
definite. 

3. Compute HjT 1 and d A = —H^'g*. 

4. Find a k , the value of a that minimizes /(x A + a d A ), using a line search. 

5. Set x A+1 = x k + 6 k , where 6 k = a A d,t, and compute f k+] = /(x A . +1 ). 

6. If ||a*d*|| 2 < e. then output x = x A+A , fix) = f k + 1 , and stop. 

Otherwise, set k = k + 1 and repeat from step 2. • 


2 E n represents the n-dimensional Euclidean space. 
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The algorithm is terminated if the L 2 norm of c^d*, i.e., the magnitude of the change in x, is less 
than e. The parameter e is said to be the termination tolerance and is a small positive constant whose 
value is determined by the application under consideration. 3 In certain applications, a termination 
tolerance on the objective function itself, e.g., \fk+i — fk\ < e, may be preferable and sometimes 
termination tolerances may be imposed on the magnitudes of both the changes in x and the objective 
function. 

So far, we have tacitly assumed that the optimization problem under consideration has a unique 
or global minimum. In practice, the problem may have more than one local minimum, sometimes 
a large number of minima, and on occasion a well-defined minimum may not even exist. We must, 
therefore, abandon the expectation that we shall always be able to obtain the best solution available. 
The best we can hope for is a solution that satisfies a number of the required specifications. 


Example 16.1 


Show that the function 


fix) = x\ + 2 x\X 2 + 2x? + 2x\ + X 2 


has a minimum. ( b ) Find the minimum of the function using Algorithm 1 with xo = [0 0] 7 as 
initial point. 


■ Solution 


(a) From basic calculus, the stationary points of a function are the points at which the 
gradient is equal to zero. If the Hessian at a specific stationary point is positive definite, 
negative definite, or indefinite , then the stationary point is a minimum, maximum, or 
saddle point', alternatively, if the Hessian is positive or negative semidefinite, then the 
stationary point can be either a maximum or a minimum point. 

The partial derivatives of /(x) are given by 

9/ 9/ 

— = 2xi +2x2 + 2 and -— = 2xi + 4x 2 + 1 

OX 1 OX2 

At a stationary point x, the gradient g is zero; hence, we obtain x = [—1.5 0.5] L 
The Hessian can be deduced as 


H = 


2 2 
2 4 


Since the principal minor determinants of H are positive, the Hessian is positive definite 
(see Sec. 5.3.6), and so x is a minimum point. 

fib) The gradient at x ( j = [0 0] is go = |2 1J 7 . The inverse of Hq is given by 


H 


-1 

0 


1 -0.5 

-0.5 0.5 


3 Parameters e, Si, and en represent termination tolerances throughout the chapter. 
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and hence the Newton direction can be obtained from step 3 of Algorithm 1 as do= 
—Hq' go = [—1.5 0.51 7 . The function under consideration is quadratic and the solution 
can be obtained with ao = 1. From step 5, Xj = x = [ — 1.5 0.5] r and /(x) = f\ = 
— 1.25. Note that Algorithm 1 will need two iterations to stop since the termination test 
in step 6 will not be satisfied until the second iteration. 


16.4 QUASI-NEWTON ALGORITHMS 


The Newton algorithm described in the preceding section has three major disadvantages. First, 
both the first and second partial derivatives of /(x) must be computed in each iteration in order 
to construct the gradient and Hessian, respectively. Second, in each iteration the Hessian must be 
checked for positive definiteness and, if it is found to be nonpositive definite, it must be forced 
to become positive definite. Third, matrix inversion is required in each iteration. By contrast, in 
quasi-Newton algorithms only the first derivatives need to be computed, and it is unnecessary to 
manipulate or invert the Hessian. Consequently, for general problems other than convex quadratic 
problems, quasi-Newton algorithms are much more efficient and are preferred. 

Quasi-Newton algorithms, like the Newton algorithm, are developed for the convex quadratic 
problem and are then extended to the general problem. The fundamental principle in these algorithms 
is that the direction of search is based on an n x n matrix S that serves the same purpose as the inverse 
Hessian in the Newton algorithm. This matrix is constructed using available data and is contrived 
to be an approximation of II 1 . Furthermore, as the number of iterations is increased, S becomes 
progressively a more and more accurate representation of II . For convex quadratic objective 
functions, S becomes identical to II 1 in n + 1 iterations where n is the number of variables. 

16.4.1 Basic Quasi-Newton Algorithm 

Let the gradients of /(x) at points x<- and x/. + i be g* and gk+\, respectively. If 


x*+i — X/. -)- 6k 


then the Taylor series gives the elements of gk+\ as 



;=i i=t 7=t 


for m — 1,2Now if /(x) is quadratic, the second and higher derivatives of /(x) are constant 
and zero, respectively, and as a result the second and higher derivatives of gk m are zero. Thus 



n 


and since 
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we have 


n 

8(k+l)m = 8km “1“ ^ ^ 
/=1 


d 2 fk 

dxk i dxk m 


Ski 


for m — 1,2, ... , n. Therefore, g*+i is given by 

g/r+1 = g k + H<V 

where H is the Hessian of /(x). Alternatively, we can write 

Ik = H<V (16.10) 


where 


and 


8 k - X/;_)_l Xk 


7 k g&+l g k 


The above analysis has shown that, if the gradient of /(x) is known at two points x k and Xj. +1 , a 
relation can be deduced that provides a certain amount of information about H, namely, Eq. (16.10). 
Since H is a real symmetric matrix with n x (n + l)/2 unknowns and Eq. (16.10) provides only n 
equations, H cannot be determined uniquely through the use of Eq. (16.10). This problem can be 
overcome by evaluating the gradient sequentially at n + 1 points, say at xo, xi, ... , x„, such that 
the changes in x, namely, 

6 0 = X! - x 0 
<5 1 = x 2 - x. 


fin -1 — x n ~ x n-l 

form a set of linearly independent vectors. Under these circumstances, Eq. (16.10) yields 

[7o 7 i ••• 7«-i] = H[^ 0 fii « n -t] 

Therefore, H can be uniquely determined as 

H= [7o7i ■ ■ ■ 7»-i] [«o fit •••<5„-t]“ 1 (16.11) 

The above principles lead to the following algorithm: 

Algorithm 2: Alternative Newton algorithm 

1. Input x 0 o and e. Input a set of n linearly independent vectors 6q,6i, ..., 6 n -i- Set k = 0. 

2. Compute g M . 

3. For i = 0 to n — 1 do: 

a. Set x*( i+ i) = x ki + Sj. 

b. Compute g w ,- + i). 

C. Set §A:(/+ 1 ) g ki‘ 

4. Compute H k using Eq. (16.11). If is not positive definite, force it to become positive definite. 

5. Determine S* = H /( 1 . 
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6. Set d k — —Sfr&to and find a k , the value of a that minimizes f(x k0 + a d*.), using a line search. 

7. Set x ( * +1)0 = x*o + a k d k and compute f (k+w = f(x (k+l)0 ). 

8. If ||a*d*|| 2 < e, then output x = x (t+l)0 , /(x) = f {k+1)0 , and stop. 

Otherwise, set k = k + 1 and repeat from step 2. • 

Algorithm 2 is essentially an alternative implementation of the Newton method in which the 
generation of H” 1 is accomplished using computed data instead of the second derivatives. However, 
as in Algorithm 1, for the general nonquadratic problem it is necessary to check, manipulate, and 
invert the Hessian in every iteration. In addition, we now need to provide a set of linearly independent 
vectors to the algorithm, namely, 6q, Si, ..., b„-\ ■ hi other words, though of considerable conceptual 
value, the algorithm is of little practical usefulness. 

Further progress toward the development of the quasi-Newton method can be made by generat¬ 
ing the matrix H 1 from computed data using a set of linearly independent vectors Sq , <5 i , ..., 6„-i 
that are themselves generated from available data. This objective can be accomplished by generating 
the vectors 


Sk = 

x k+l = x k + 


and 


Ik = 8^+1 - g k 

and then making an additive correction to S k of the form 

Sfc+i = S k + c k 


(16.12) 

(16.13) 


(16.14) 


for k = 0, 1— l.Ifa correction matrix C k can be found such that the conditions 

Sfc+ 17 ; = Si forO < i < k (16.15) 

are satisfied and the vectors ^i, •. ■, and 7 0 , 7 ,,..., 7 n _ x generated by this process are 
linearly independent, then for the case k = n — 1 we can write 

S„[7o7i 7n-i] = [<5o <5i 5„_t] 

or 

s„ = [So Si ... S n - 1 ][ 7 0 7 1 7 n-i ] _1 (16.16) 

Now from Eqs. (16.11) and (16.16), we have 

S„ = H~‘ (16.17) 

and if k — n, Eqs. (16.12) and (16.17) yield the Newton direction 

S n - -H-'g,, 


(16.18) 
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Therefore, subject to conditions (i) and (ii) stated earlier, the solution of a convex quadratic problem 
can be obtained from Eqs. (16.13) and (16.18) as 

x = x„ +1 = x„ - H 'g„ 

The above principles lead to the basic quasi-Newton algorithm which is as follows: 

Algorithm 3: Basic quasi-Newton algorithm 

1. Input xo and s. Set So = I„ and k = 0. Compute go. 

2. Set d k = — S/tgt and find a k , the value of a that minimizes f(x k + a d*), using a line search. 

3. Set 6 k — a k d k and x*+i = x* + 6 k , and compute f k+ i = /(x*+i)- 

4. If H^fclfa < e, then output x = x* + i, /(x) = f k+ \ and stop. 

5. Compute g* + i and set j k = g*. +1 - g k . 

6. Compute Sa+i = S k + C k . 

7. Check Sa+i for positive definiteness and if it is found to be nonpositive definite force it to become 
positive definite. 

8. Set k = k + 1 and go to step 2. • 

In step 2, the vector —S^-gA is denoted as dA, instead of 6 k as in Eq. (16.12), and /(x k + adk) 
is minimized with respect to a. The purpose of this modification is to make the algorithm applicable 
to the general nonquadratic problem where — SAgA may not be the Newton direction. Matrix Sa is 
required to be positive definite for each k to ensure that vector dr is a descent direction in each 
iteration. To obtain a descent direction in the first iteration, So is assumed to be the n x n unity matrix 
in step 1 . Vector -y k in step 5 is required for the computation of correction matrix C* in step 6 , as 
will be demonstrated in Sec. 16.4.2 below. 

Algorithm 3 eliminates the need to input a set of linearly independent vectors 6 \, ..., 6 n _ i 
and, in addition, the inversion of Ha is replaced by an additive correction to Sa- However, matrices 
Si, S 2 , ... need to be checked for positive definiteness and may need to be manipulated. This can be 
easily done in practice by diagonalizing Sa+ 1 and then replacing any nonpositive diagonal elements by 
corresponding positive ones. However, this would increase the computational load quite significantly. 

16.4.2 Updating Formulas for Matrix S* +1 

The updating formula for matrix Sa+i of Eq. (16.14) must satisfy strict requirements to be useful 
in Algorithm 3. As was stated earlier, for a convex quadratic problem, Eq. (16.15) must be satisfied 
and the vectors 60 , 61 , ..., <5„_i and 7 0 , 7 ,...., ~f n _\ must be linearly independent. The deriva¬ 
tion and properties of updating formulas of this type have received considerable attention during 
the past 30 years or so, and several distinct formulas have appeared in the literature. Early in the 
development of the subject, the so-called rank-one formula was proposed, in which the correction 
matrix Ca is of rank one. This has largely been replaced in recent years by rank-two formulas, like 
the Davidon-Fletcher-Powell (DFP) and the Broyden-Fletcher-Goldfarb-Shanno (BFGS) formulas 
[6-10]. A very important property of these two formulas is that a positive definite matrix Sa yields a 
positive definite Sa+i not only for convex quadratic problems but also for the general nonquadratic 
problem, provided that the line search in step 2 of the algorithm is exact (see Fletcher [ 6 ] for proof). 
This property also holds in the case where an inexact line search is used in step 2, except that a scalar 
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quantity inherent in the computation of C k must be forced to remain positive. The usefulness of this 
property in Algorithm 3 is obvious: the checking and manipulation of S A+ i in step 7 of the algorithm 
become unnecessary, and hence a considerable amount of computation can be avoided. 

The DFP and BFGS updating formulas are given by 


5*+l 


= s, 


fiktf S*7*7[S* 


ik 6 k 7 k SkUk 


(16.19) 


and 


5/t+l 


= s* 


Jk^klk] 
lk*>k ) 7 16 k 


{6g T k S k + S k ~/ k 6l) 

7 l6 k 


(16.20) 


respectively. A condition that guarantees the positive definiteness of S A+ i in both formulas is 

s klfk = tfgk+i ~ tfgk > 0 (16.21) 

This will be put to good use in Algorithm 5. 


16.4.3 Inexact Line Searches 

In optimization algorithms in general, the bulk of the computational effort is spent executing line 
searches. Consequently, the amount of computation required to solve a problem tends to depend 
critically on the efficiency and precision of the line search used. If a high-precision line search is 
mandatory in a certain algorithm, then the algorithm can spend a considerable amount of computa¬ 
tional effort minimizing the objective function with respect to scalar a. For this reason, low-precision 
or inexact line searches are usually preferable, provided of course that their use does not affect the 
convergence properties of the algorithm. Quasi-Newton algorithms have been found to be quite tol¬ 
erant to line-search imprecision. As a result, inexact line searches are almost always used in these 
algorithms. An important line search of this type will now be examined. 

Let 

x*+t = x* + a d A 

where d A is a given descent direction vector and a is an independent variable, and assume that /(x* + 1 ) 
is a unimodal function* of a, with a minimum at some point a = a where a > 0, as depicted in 
Fig. 16.2a. The linear approximation of the Taylor series for /(x*+i) is of the form 

/(xt+i) = /(xQ + agJd* (16.22) 


where 

T df(x k + a d k ) 
g 1 dfc = -- 

da a=Q 

is the slope at the origin of f(x k + a d/ 0 ) as a function of a. Eq. (16.22) represents line A depicted 
in Fig. 16.2a. Similarly, the equation 


/(x*+i) = f(x k ) + p a g[ d A - 


(16.23) 


4 A unimodal function is one that has only one minimum. 
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Figure 16.2 Inexact line search: (a) Case where the conditions in Eqs. (16.25) and (16.26) are both satisfied, 
(b) case where the condition in Eq. (16.25) is violated. 

where 0 < P < 0.5 represents a line (line B in Fig. 16.2a) whose slope ranges from 0 to 0.5g ; [d/,, 
depending on the value of p. Let us assume that this line intersects the curve in Fig. 16.2a at point 
a = a 2 - On the other hand, the equation 


g T k+ A = og T k & k 


( 16 . 24 ) 
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r 

a 

(c) 


a 


Figure 16.2 Cont’d 


Inexact line search: (c) Case where the condition in Eq. (16.26) is violated. 


where 0 < a < 1, and a > p relates the derivative of /'(x/. + i) at some point a — a\ to the derivative 
of the function at a — 0 and represents line C in Fig. 16.2a. Since 0 < a < 1, we have 0 < oq < a. 

Equations (16.23) and (16.24) define an interval [a 1; oq | that brackets the minimum point. 
Consequently, the two equations can be used as a termination criterion in a line search, much like 
the use of a termination tolerance on x or /(x) in Algorithms 1 to 3. This possibility will now be 
examined. 

Let us assume that a mechanism is available by which an estimate of a, say ao, can be generated. 
If the actual value of at a = a {] is less than the value predicted by the linear approximation 

of Eq. (16.23), that is, 

/( xa + i ) < f(*k) + P oiogldk (16.25) 

then ao < oi 2 . On the other hand, if the actual slope at a — an is less negative (more positive) than 
the slope of the line in Eq. (16.24), that is, 

gI + ,cE >ag[d, (16.26) 

then a[ < ao- Under these circumstances, we have a\ < ao < ao, as depicted in Fig. 16.2a, and a 
certain reduction in /(Xfc+i) is achieved, which can be considered to be acceptable. In other words, 
if both Eqs. (16.25) and (16.26) are satisfied, then ao can be accepted as a reasonable approximation 
of a. 

If either of the conditions in Eqs. (16.25) and (16.26) is violated, then ao is outside the interval 
[ai,a 2 ] and the reduction in /(x/ f+i ) can be considered to be unacceptable. If the condition in 
Eq. (16.25) is violated, then ao > a 2 , as depicted in Fig. 16.2/?; since 0 < a < a q, a better estimate 
for a (say ao) can be deduced by using some interpolation formula. If the condition in Eq. (16.26) 
is violated, then 0 < ao < ai, as depicted in Fig. 16.2c; in this case, a better estimate ao can be 
deduced by using some extrapolation formula. With a new estimate for a available, the conditions 
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in Eqs. (16.25) and (16.26) can be checked again and, if either of the two is not satisfied, the process 
is repeated. When an estimate of a is found that satisfies both Eqs. (16.25) and (16.26), the search 
is terminated. The precision of such a line search can be controlled by choosing the values of p and 
a since these parameters control the length of interval [aj, af\. 

Interpolation and extrapolation formulas that can be used in the above approach can be readily 
deduced by assuming a quadratic representation for f(x k + a d<.). If the value of this function and 
its derivative with respect to a are known at two points, say, at a = a L and a = ao where a L < « (l , 
then for ao > a .2 we can show that 


and for oiq < a. \ 


where 


(a 0 - ot L ) 2 f' L 

a o = oil +-— 

2[/l -fo + (ao - «l)/I1 


a 0 = a 0 


(a 0 - a L )fj 

(. f' L ~ fit) 


//, = /(x* + a L d k ) 

//, = f'(x k + a L d k ) = g(x k + a L d k ) T d k 
fo = f(*k + aod*) 

/o = f'fx-k + oiod k ) = g(x* + a 0 d^) 7 'd A . 


(16.27) 


(16.28) 


An inexact line search due to Fletcher [6] based on the above principles is as follows: 


Algorithm 4: Fletcher inexact line search 

1. Input xj, and di-. Initialize algorithm parameters p, cr, r, and x • Set a k = 0 and an = 10". Compute 
fo- 

2. Compute f L = f(x k + a L d A .) and f' L = g(x* + a L d k ) T d k . 

3. Initialize a 0 , say a 0 = 1 . 

4. Compute f 0 = f(x k + o-od*). 

5. (Interpolation) 

If fo > /l + P (ao - a L )f' L , then do: 

a. If ao < ay, then set an = ao- 

b. Compute a 0 using Eq. (16.27). 

c. Compute a 0L = a L + r(ay — a L )\ if a 0 < a 0L , then set a 0 — aoL- 

d. Compute aou = an — r(an — an)', if ao > aou, then set ao = aou- 

e. Set ao = ao and go to step 4. 

6. Compute / 0 ' = g(x k + a 0 d k ) T d k . 

7. (Extrapolation) 

If /o < a f' L , then do: 

a. Compute Aa 0 = (a 0 - a L )fJ{f' L - /„') (see Eq. (16.28)). 

b. If Aao < r(ao — an), then set Aao = r(ao — an)- 

c. If Aa 0 > x(a 0 - a L ), then set Aa 0 = x(“o - a L )- 

d. Compute a 0 = a 0 + Aa 0 . 

e. Set a L = a 0 , a 0 = a 0 , fn = fo, f' L = /o' and go to step 4. 

8. Output ao and fo, and stop. • 
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Assuming that d/ is a descent direction of /(x) at point X/ f , the algorithm will carry out 
interpolations and/or extrapolations as necessary, which will progressively reduce the value of /(x* + 
a d*). When the conditions in Eqs. (16.25) and (16.26) are simultaneously satisfied, the algorithm 
terminates. The algorithm maintains a running bracket [oil, oiu ] on the minimum point such that 
oi l < ao < at/; if the interpolation formula yields a value of a 0 outside this interval or very close to the 
lower or upper limit, a more reasonable value is assigned to Hq in step 5c or 5 d. Similarly, if the value 
of Aao predicted in step la is negative, very small or very large, a more reasonable value is assigned 
to Aao in step Ibovlc. The precision of the line search depends on the values of p and a. Small values 
likep — a =0.1 yield a high-precision line search, whereas the values p = 0.15 and a = 0.9 yield a 
somewhat imprecise one. Suitable values for r and / are 0.1 and 9, respectively. Further details about 
this line search can be found in the first edition of Fletcher [6]. A closely related inexact line search 
proposed by Al-Baali and Fletcher can be found in Ref. [11] (see also second edition of Fletcher [6]). 

16.4.4 Practical Quasi-Newton Algorithm 

A practical quasi-Newton algorithm that eliminates the problems associated with Algorithms 1 to 3 
is detailed below. This is based on Algorithm 3 and uses a slightly modified version of Algorithm 4 
as inexact line search. The algorithm is flexible, efficient, and very reliable, and is readily applicable 
for the design of digital filters and equalizers, as will be shown in Secs. 16.7 and 16.8. 

Algorithm 5: Practical quasi-Newton algorithm 

1. (Initialize algorithm) 

a. Input xo and ei. 

b. Set k = m = 0. 

c. Set p= 0.1,ct =0.7, r = 0.1, x = 0.75, M = 600, and s 2 = 10~ 10 . 

d. Set S 0 = I„. 

e. Compute f 0 and g 0 , and set m = m + 2. Set f 00 = f 0 and A f Q = f 0 . 

2. (Initialize line search) 

a. Set d, = -S t .g /; . 

b. Set a L = 0 and a v = 10". 

c. Set f L = f 0 and compute f' L = g(x* + a L di.) 3 ’d <r . 

d. (Estimate a 0 ) 

If \f' L \ > e 2 , then compute a 0 = — 2A/ 0 /// ; otherwise, set a 0 = 1- 
If ao 5 0 or «o > 1, then set ao — 1. 

3. Set 8it = aod* and compute /o = /(x^ + <5/). 

Set m = m + 1. 

4. (Interpolation) 

If /o > /l + P («o - “l)/l and |(/ L - / 0 )| > e 2 and m < M, then do: 

a. If a 0 < an, then set a v = a 0 . 

b. Compute a 0 using Eq. (16.27). 

c. Compute aoi = a L + z(au — a L )\ if a 0 < ao l, then set a 0 — 5 0i . 

d. Compute a ou = an — z(a v — a L )\ if a 0 > ctou, then set a 0 = a ou . 

e. Set a 0 = a 0 and go to step 3. 

5. Compute / 0 ' = g(xj. + a 0 dt) r d t and set m = m + 1. 

6. (Extrapolation) 

If / 0 ' < af' L and \(fn — /o)| > e 2 and m < M, then do: 

a. Compute Aao = (a 0 - «l)/o'/(/l - /o') ( see E h- (16.28)). 
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b. If Aao 5 0, then set do — 2ao; otherwise, set a 0 = &o + Aao- 

c. Compute a ou = a 0 + X(^u — “o); if > d ou , then set a 0 = a ou . 

d. Set a L = a Q , a 0 = d 0 , f L = f 0 , f' L = /„' and go to step 3. 

7. (Check termination criteria and output results) 

a. Set x* +1 = X* + 6 k . 

b. Set A/ 0 = /oo - fo- 

c. If (|| 6 k II 2 < Si and | A/o| < £i) or m > M , then output x = x^+i, /(x) = ft+i, and stop. 

d. Set /oo = fo- 

8. (Prepare for next iteration) 

a. Compute g k +\ and set -y k = g^+i - g k . 

b. Compute D = 6 k y k ; if D < 0, then set S^ + i = I„; otherwise, compute Sj+iusing Eq. (16.19) 
orEq. (16.20). 

c. Set k = k + 1 and go to step 2. • 

Index m maintains a count of the number of function evaluations and is increased by one for 
each evaluation of fo or /j in step 3 or 5, and M is the maximum number of function evaluations 
allowed. When m becomes greater than M, the algorithm stops. 

The estimate of a.Q in step 2d can be obtained by assuming that the function f(x k + a d/) can 
be represented by a quadratic polynomial of a and that the reduction achieved in f(x k + a d/.) by 
changing a from 0 to ao is equal to A/o, the total reduction achieved in the previous iteration (see 
Prob. 16.11). This estimate can sometimes be quite inaccurate and may in certain circumstances 
become negative due to numerical ill-conditioning. For these reasons, if the estimate is equal to or 
less than zero or greater than unity, it is replaced by unity. 

The quadratic extrapolation in step 6 of the algorithm may sometimes predict a maximum point 
at some negative value of a instead of a minimum point at some positive value of a (see Prob. 16.12). 
If such a case is identified in step 6b, the value of 2ao is assigned to ao to ensure that a is changed 
in the direction of descent. If a/j is fixed by the interpolation, the minimum point cannot exceed this 
value; and, if extrapolation results in an unreasonably large value of a () , it is replaced by the value 
aou computed in step 6c. 

While a positive definite matrix S* will ensure that d k is a direction of descent of function /(x) 
at point x k , in some rare occasions the function f{x k + a d*-) may not have a well-defined minimum 
point. On the other hand, when the value of the function is very small, numerical ill-conditioning may 
arise occasionally due to roundoff errors. To avoid these problems, interpolation or extrapolation is 
carried out only if the expected reduction in the function f(x k + a d^) is larger than £2 and an upper 
limit in the number of function evaluations has not been exceeded. 

If the DFP or BFGS updating formula is used in step 8 b and the condition in Eq. (16.21) 
is satisfied, then a positive definite matrix S k will result in a positive definite S/ f+ 1 , as was stated 
earlier. We will now demonstrate that if the Fletcher inexact line search is used and the search is 
not terminated until the inequality in Eq. (16.26) is satisfied, then Eq. (16.21) is, indeed, satisfied. 
When the search is terminated in the A th iteration, we have ao = a k and from step 3 of the algorithm 
6 k = a k d k - Now from Eqs. (16.21) and (16.26), we obtain 


shk = SI&+1 - s T k & 


= «t(gt+idt -g T k d k ) 
> u k (o - l)g[d k 
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If d* is a descent direction, then g[ch < 0 and otk > 0. Since a < 1, we conclude that 

6 llk > o 

Under these circumstances, the positive definiteness of S* is assured. In exceptional circumstances, 
the inexact line search in Algorithm 5 may not force the condition in Eq. (16.26) if the quantity 
\{f L — / 0 )| is less than so, and a nonpositive definite S/ ;+ i matrix may on rare occasions arise. To 
safeguard against this possibility and ensure that a descent direction is achieved in every iteration, 
the quantity <5j ~( k is checked in step 8 b and if it is found to be negative or zero, the unity matrix I„ 
is assigned to S*+i. 

The DFP and BFGS updating formulas are very similar, and there are no clear theoretical 
advantages that apply to one and not the other. Indeed, the two formulas are interrelated in terms of a 
mathematical principle known as duality , which allows each of the two formulas to be derived from 
the other by simple algebraic manipulation. Nevertheless, extensive experimental results reported 
by Fletcher [6] show that the use of the BFGS formula tends to yield algorithms that are somewhat 
more tolerant to line-search imprecision. As a consequence, algorithms based on the BFGS formula 
are somewhat more efficient. 


Example 16.2 


In an application, the piecewise-continuous function 


D(co) = 


2u> 

for 0 < co < 6 

12 

for 6 < co < 12 

a> + 24 

for 12 < m < 16 

8 

for 16 < co < 22 



a>, rad/s 


Figure 16.3 Plots of D(cu) and P(ai) (Example 16.2). 
-£>(w);- P{cd). 
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(see Fig. 16.3) has to be approximated by a polynomial of the form 


5 


P(a>) — ^2 a k° )k 


Using Algorithm 5, obtain a set of coefficients cik for k = 0, 1, ..., 5 that minimizes 
difference between D(co) and P(co) in the range 0 < a> < 22 in a least-squares sense. 

■ Solution 

A suitable objective function can be constructed as 



where &>,- =2i — 2 and 


x — [xi x 2 ■ ■ ■ x 6 ] t = [o 0 fli ■ ■ ■ a 5 ] T 


by sampling the error D(w ) — P(co) at 12 points. The first partial derivatives of 'I'(x) can 
be readily determined as 



for k — 1, 2, ..., 6. Using Algorithm 5 with an initial point x (l = [0 0 ■ ■ ■ 0 ] 7 and 
a termination tolerance S\ = 10 6 , the coefficients in Table 16.1 were obtained. The 
progress of the algorithm is illustrated in Table 16.2. The number of function evaluations 
is equal to the number of evaluations of the objective function 'b(x) plus the number of 
evaluations of the partial derivative function The polynomial P(a>) is com¬ 

pared with D(o>) in Fig. 16.3 and the error between the two is plotted versus frequency 

Table 16.1 Coefficients of P(uj) 

(Example 16.2) 


Coefficient Value 


ao -7.626758E - 2 

fli 1.801233 

a 2 2.389372E - 1 

a 2 -5.286809 E - 2 

a 4 2.829081E-3 

a 5 -4.791669E - 5 
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Table 16.2 Progress of algorithm 
(Example 16.2) 


k 

Funct. evals. 

'F(x) 

0 

7 

5.060000E+2 

5 

44 

3.104894 

10 

87 

1.017671 

13 

114 

1.016952 



01, rad/s 

Figure 16.4 Error |e(x, a>)[ versus ai (Example 16.2). 

in Fig. 16.4. Note that the error is unevenly distributed with respect to the frequency. 
This is a common feature of least-squares solutions and is sometimes of concern. 


16.5 MINIMAX ALGORITHMS 

The design of digital filters can be accomplished by minimizing one of the norms described in 
Sec. 16.2. If the L \ or L\ norm is minimized, then the sum of the magnitudes or the sum of the squares 
of the elemental errors is minimized. The minimum error achieved usually turns out to be unevenly 
distributed with respect to the frequency and may exhibit large peaks (e.g., see the error achieved for 
Example 16.2 depicted in Fig. 16.4) which are often objectionable. If prescribed amplitude response 
specifications are to be met, the magnitude of the largest elemental error should be minimized and, 
therefore, the norm of the error function should be used. Algorithms developed specifically for 
the minimization of the L 00 norm are known as minimax algorithms and lead to designs in which the 
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error is uniformly distributed with respect to frequency. The solutions obtained tend to be equiripple, 
much like the solutions obtained by using the elliptic approximation of Chap. 10, which is, in effect, 
the minimax solution for filters with piecewise-constant amplitude responses. 

The most fundamental minimax algorithm is the so-called least-pth algorithm, which involves 
minimizing an objective function of the type given in Eq. (16.5) for increasing values of p, say 
p = 2,4,8,, and is as follows [12]. 


Algorithm 6: Least-pth minimax algorithm 

1. Input xo and ei. Set k = 1, p = 2, p = 2, Eg = 10". 

2. Initialize frequencies coi, o> 2 , ..., u>k- 

3. Using X(._| as initial value, minimize 


♦*(x) = £(x) 



k,(x)| 

£(x) 


i Ip 


(16.29) 


where 

£(x) = max |e, (x)| 

1 <i<K 


with respect to x, to obtain x*. Set = E(x). 

4. If \Ek-i — Ek\ < fii, then output X* and £*, and stop. Otherwise, set p = pp, k = k + 1 and go to 
step 3. • 


The underlying principle for Algorithm 6 is that the minimax problem is solved by solving a 
sequence of closely related problems whereby the solution of one renders the solution of the next 
one more tractable. Parameter p in step 1, which must obviously be an integer, should not be too 
large in order to avoid numerical ill-conditioning. A value of 2 was found to give good results. 

The minimization in step 3 can be carried out by using any unconstrained optimization algo¬ 
rithm, for example. Algorithm 5 described in the previous section. The gradient of 44 (x) is given by 
[ 12 ] 


V44(x) = 



kiOOl 

E(x) 


(1/P)-1 K 

E 


i=l 


k/( x )l 

E(x) 


p- i 

Vki(x)| 


(16.30) 


The preceding algorithm works very well, except that it requires a considerable amount of 
computation. An alternative and much more efficient minimax algorithm is one described in [13,14]. 
This algorithm is based on principles developed by Charalambous [15] and involves the minimization 
of the objective function 

*(x, A, H) = E f)] 2 + * [ <Mx, §)] 2 

i^I\ i€/2 


(16.31) 











740 DIGITAL SIGNAL PROCESSING 


where | and a, for i — 1,2 ,..., K are constants 

<Mx,|) = k,-(x)|-§ 


h = 

[i ■ 0i (x, £) > 

0 and A,- 

>0} 

(16.32) 

h = 

{/ : 0i(x, |) > 

0 and A,- 

= 0} 

(16.33) 


The halves in Eq. (16.31) are included for the purpose of simplifying the gradient (see Eq. (16.34)). 
If 

(a) the second-order sufficiency conditions for a minimum of E(x) hold at x, 

(b) a, = a, for i — 1,2, .... K where A,- are the minimax multipliers corresponding to the 
minimum point x of E(x), and 

(c) E(x) — § is sufficiently small 


then it can be proved that x is a strong local minimum point of function Vl/(x, A, |) given by 
Eq. (16.31) (see [15] for details). In practice, the conditions in (a) are satisfied for most practical 
problems. Consequently, if multipliers A, are forced to approach the minimax multipliers A, and 
| is forced to approach E(x), then the minimization of E(x) can be accomplished by minimizing 
Tlx. A, |) with respect to x. A minimax algorithm based on these principles is as follows: 


Algorithm 7: Charalambous minimax algorithm 


1. Input xo and si. Set k = 1, |i = 0, An = kn — • • ■ = Ai* = 1, Eq = 10". 

2. Initialize frequencies a) 1 ,( 02 ,, u>k- 

3. Using xt-i as initial value, minimize ilfix, A*,, |t) with respect to x to obtain x k . Set 

E k = E(x k ) = max |e,(xt)| 

l<i<X 


4. Compute 


and update 


< h/t — k ki tpj(x k , |t) + <Mxt> |t) 

ieli /e /2 


A(t+i); — < 


A k i<t>i(x k , |t)/<bt 
<Pi(x k , It)/4>t 


0 


for i e 1 1 
for i e E 
for i e / 3 


for i = 1, 2, ..., K where 


h = U ■ 0,(xt, It) > 0 and h kl > 0) 
h = [i ■ 0/(xt, It) > 0 and k ki = 0) 


and 


h = E : </>;(Xt,!t) < 0} 
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5. Compute 

K 

?*+1 = ^(t+i>ki(x)| 

i= 1 

6. If I^a-i — Eh | < si, then output x* and Ek, and stop. Otherwise, set k = k + 1 and go to 
step 3. • 

The gradient of 'kfx, A*, §*), which is required in step 3 of the algorithm, is given by 
V'l'fx, A t , &) = ^2 A k 0,(x, ?A-)V|e,(x)| 

l'6/l 

+ D^(x,^)V|e ( (x)| (16.34) 

iel2 

Constant £ is a lower bound of the minimum of E(x) and as the algorithm progresses, it 
approaches E(x) from below. Consequently, the number of functions 0,(x, q) that do not satisfy 
either Eq. (16.32) orEq. (16.33) increases rapidly with the number of iterations. Since the derivatives 
of these functions are unnecessary in the minimization of 4>(x, A, £), they need not be evaluated. 
This increases the efficiency of the algorithm quite significantly. 

As in Algorithm 6, the minimization in step 3 of Algorithm 7 can be carried out by using 
Algorithm 5. 


16.6 IMPROVED MINIMAX ALGORITHMS 

To achieve good results in the above minimax algorithms, the sampling of e(x,co) with respect to co 
must be dense; otherwise, the error function may develop spikes in the intervals between sampling 
points during the minimization. This problem is usually overcome by using a fairly large value of 
K of the order of three to six times the number of variables, e.g., if an eighth-order digital filter is 
to be designed, a value as high as 100 may be required. In such a case, each function evaluation in 
the minimization of the objective function would involve computing the gain of the filter as many 
as 100 times. A single optimization may sometimes necessitate 300 to 600 function evaluations, 
and a minimax algorithm like Algorithm 6 or 7 may require 5 to 10 unconstrained optimizations to 
converge. Consequently, the amount of computation required to complete a design is considerable. 

A technique will now be described that can be used to suppress spikes in the error function 
without using a large value of K [16]. The technique entails the application of nonuniform variable 
sampling and involves the following steps: 

1. Evaluate the error function in Eq. (16.3) with respect to a dense set of uniformly spaced fre¬ 
quencies that span the frequency band of interest, say u>\, a> 2 , where L is fairly large, 

of the order of 10 x K. 

2. Segment the frequency band of interest into K intervals. 

3. For each of the K intervals, find the frequency that yields maximum error. Let these frequencies 
be obi for i = 1,2,..., K. 

4. Use frequencies &),■ as sample frequencies in the evaluation of the objective function, i.e., set 
a>j = a>i for i = 1, 2,..., K. 
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By applying the above nonuniform sampling technique before the start of the second and 
subsequent optimizations, frequency points at which spikes are beginning to form are located and 
are used as sample points in the next optimization. In this way, the error at these frequencies is 
reduced and the formation of spikes is suppressed. 

Assume that a digital filter is required to have a specified amplitude response with respect 
to a frequency band B that extends from u>\ to co L , and let d>\, a> 2 , ■ ■., d>i be uniformly-spaced 
frequencies such that 


a>i = co/-i + A co 


for i = 2, 3 ,,L where 


A co = 


o) L - £«i 
L - 1 


(16.35) 


These frequency points may be referred to as virtual sample points. Band B can be segmented into 
K intervals, say £2j to £2^ such that £2 | and Qk are of width Aco/2, fA and £2 jj_j are of width lAco, 
and £2, for / = 3, 4,..., K — 2 are of width 2lAa> where I is an integer. These requirements can be 
satisfied by letting 


£l\ = { co \ co\ < co < co\ + -Aco 


£22 = < co : co\ + - A co <o><<wi+ (/ +- ) A&> 


£2; = <^co : co\ + 
for i = 3, 4,..., K — 2 

£2^_i = < co : coi 


(2 i - 5)1 + - 


A co < co < co i + 


( 2 i - 3 )/ + - 


A co 


( 2 K - 1)1 + - 


A co <&><®i + 


(2 K ~6)l+ 2 


A co 


and 


£2^ = \ co '. co\ + 


( 2 K -6)l+- 


A co < co < col 


where 


col = co\ + [(2 K — 6)1 + 1 ] A co 


The scheme is feasible if 


L = (2K — 6)1 + 2 


(16.36) 


(16.37) 


according to Eqs. (16.35) and (16.36), and is illustrated in Fig. 16.5 for the case where K — 8 and 
/ = 5. 
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Figure 16.5 Segmentation of frequency axis. 


In the above segmentation scheme, there is only one sample in each of intervals Q| and Qk J 
samples in each of intervals fii and Q A - _ |, and 21 samples in each of intervals JT2 4 , ..., Qk- 2 , as 
can be seen in Fig. 16.5. Thus step 3 of the technique will yield co\ — u>\ and a> K — d> L , that is, the 
lower and upper band edges are forced to remain sample frequencies throughout the optimization. 
This strategy leads to two advantages: (a) the error at the band edges is always minimized, and (b) a 
somewhat higher sampling density is maintained near the band edges where spikes are more likely 
to occur. 

In the above technique, the required amplitude response needs to be specified with respect to 
a dense set of frequency points. This problem can be overcome through the use of interpolation. 
Let us assume that the amplitude response is specified at frequencies o>i to a>s, where u>\ — d>\ and 
a>s = o>l- The required amplitude response for any frequency interval spanned by four successive 
specification points, say cbj < u> < <bj + 3, can be represented by a third-order polynomial of o> of the 
form 


Mo(o») = cioj + ciijco + ci 2 jur + a^jcA (16.38) 

and by varying j from 1 to S — 3, a set of S — 3 third-order polynomials can be obtained which 
can be used to interpolate the amplitude response to any desired degree of resolution. To achieve 
maximum interpolation accuracy, each of these polynomials should as far as possible be used only 
in the center of its frequency range of validity. Hence, the first and last polynomials should be used 
for frequency ranges d>i < co < d >3 and d>s ~2 < a> < d>s, respectively, and the jth polynomial for 
2 <j<S — 4 should be used for the frequency range cbj+i < co < a>j + 2. 

Coefficients a, 7 - for i = 0, 1, ..., 3 and j = 1 to S — 3 can be determined by computing 
cb m , ( cb rn ) 2 , and (cb m ) 3 for m = j, j + 1,..., j + 3, and then constructing the system of simultaneous 
equations 

CljSkj = M 0j/ (16.39) 


a j = [ao; a 3j ] and M 0; = [M 0 (cbj) ■■■ M 0 (cbj +3 )] T 


where 











744 DIGITAL SIGNAL PROCESSING 


are column vectors and H 7 is the 4x4 matrix given by 

1 S)j ( 6b j ) 2 ( 0>j ) 3 
1 cb j+ i (&> j+ 1 ) 2 (cbj+if 
1 cb j+ 2 (&> j+ 1) 2 (cbj+2) 3, 

1 cb j+ 3 (d) j+i ) 2 (cb j+3 ) 3 _ 

Therefore, from Eq. (16.39) we have 

a j = Cl] l M 0j (16.40) 

The above nonuniform sampling technique can be incorporated in Algorithm 6 by replacing 
steps 1, 2, and 4 by the modified steps 1A, 2A, and 4A listed below. The filter to be designed is 
assumed to be a single-band filter, for the sake of simplicity, although the technique is applicable to 
filters with an arbitrary number of bands. 

1A. a. Input xo and gj. Set k = 1, p = 2, p. = 2, Eq = 10". Initialize K. 

b. Input the required amplitude response Mo(a > m ) for m = 1.2,..., .S'. 

c. Compute L and Aco using Eqs. (16.37) and (16.35), respectively. 

cl. Compute coefficients u lf for i = 0, 1,..., 3 and j = 1 to S — 3 using Eq. (16.40). 
e. Compute the required amplitude response for d >\, u> 2 , ■ ■ ■, u>l using Eq. (16.38). 

2A. Set cui = ibi, co 2 = cb\ + i, coi = a> 2 (!- 2 )t+i for i = 3, 4, ..., K — 2, cok-i = u>L-h an d 
(Ok = (Ol- 

4A. a. Compute |e/(x*)l f° r t = 1, 2,..., L using Eqs. (16.3) and (16.4). 

b. Determine frequencies cu, for i = 1,2 ,..., K and 

P k = P(x k ) = max \ei(x k )\ 

1 <i<L 

c. Set Co, = cbj for i = 1, 2,..., K. 

d. If \Ek-i — E k | < 8 1 and \P k — E k \ < e\, then output x k and E k , and stop. Otherwise, set 
p = /xp, k — k + 1 and go to step 3. 

Similarly, the technique can be applied to Algorithm 7, by replacing steps 1, 2, and 6 by the 
following modified steps: 

1A. a. Input xo and e i. Set k = 1, = 0, kn = X 12 = ... = X\k = 1, £0 = 10". Initialize K. 

b. Input the required amplitude response M t) (d >,„) for m = 1, 2,..., S. 

c. Compute L and A co using Eqs. (16.37) and (16.35), respectively. 

d. Compute coefficients u,j for i = 0, 1,..., 3 and j = 1 to S — 3 using Eq. (16.40). 

e. Compute the required amplitude response for ft>i, u> 2 , ■ ■ ■ ,u>l using Eq. (16.38). 

2A. Set co\ = co 1 , 0)2 = cbi+i, (Oi = d> 2 (i- 2 )i+i for i = 3, 4,..., K — 2, co K _ 1 = &)/,_/, and 
(Ok = (Ol¬ 
ga. a. Compute |e,-(xjt)l f° r t = 1, 2,..., L using Eqs. (16.3) and (16.4). 
h. Determine frequencies &j, for i = 1, 2,..., K and 

P k = P(i k ) = max |e,(x^)| 

1 <i<L 

c. Set ft),- = (5/ for i = 1, 2,..., K. 
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d. If \Ek~\ — Ei -| < s i and P k — Ek < S \, then output x* and £*, and stop. Otherwise, set 
k — k + 1 and go to step 3. 

In step 2A, the initial sample frequencies a>\ and o>k are assumed to be at the left-hand and 
right-hand band edges, respectively; o :>2 and u>k- i are taken to be the last and first frequencies in 
intervals fT and Qk- i , respectively; and each of frequencies a >3 , a>4, ..., <x>k- 2 is set near the center 
of each of intervals O3, O4, ..., Q-k-2- This assignment is illustrated in Fig. 16.5 for the case where 
K = 8 and I = 5. 

Without the nonuniform sampling technique, the number of samples K should be chosen to 
be of the order of three to six times the number of variables, depending on the selectivity of the 
filter. While a value of 50 may be entirely satisfactory for an eighth-order lowpass filter with a wide 
transition band, a value of 100 may not be adequate for a highly selective narrow-band bandpass filter 
of the same order. With the technique, the number of virtual samples is approximately equal to 2 lx K, 
according to Eq. (16.37). As / is increased above unity, the frequencies of maximum error <y, become 
progressively more precise, owing to the increased resolution; however, the amount of computation 
required in step 4A of Algorithm 6 or step 6 A of Algorithm 7 is proportionally increased. Eventually, 
a situation of diminishing returns is reached whereby further increases in / bring about only slight 
improvements in the precision of the s. The values K = 35 and 1 = 5, which correspond to 
35 actual and 322 virtual sample points, were found to give excellent results for a diverse range of 
designs, including some complex 28th-order phase-equalizer designs (see Sec. 16.8). 


16.7 DESIGN OF RECURSIVE FILTERS 

The application of Algorithms 6 and 7 for the design of recursive digital biters can be readily 
accomplished by obtaining expressions for the objective functions 'lT(x) and T(x, (/) and their 
gradients. 


16.7.1 Objective Function 


The amplitude response of an /Vth-order biter is given by Eqs. (16.1) and (16.2) as 


j 

Mix, ©) = 

j= 1 


Njjco) 

Djico) 


where 

Nj(a> ) = [l + Oqj + a\j + 2aij(l + aoj ) cos coT + 2aoj cos 2 aoT] 2 


and 

Dj(co ) = [l + b\j + b]j + 2b\j{\ + boj) cos coT + 2boj cos 2 coT] 2 
for 7 = 1,2,...,/. Hence, Eqs. (16.3) and (16.4) yield 


e,(x) = M(x, a>i) - M 0 (®,) 


and from Eqs. (16.29) and (16.31), T/Tx) and T(x, A;., i/) can be formed. 
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16.7.2 Gradient Information 

Since in the formula for the error function is a constant, we obtain 

3e,(x) aoi + flu cos ®, T + cos 2a>, T 


for 1 = 1,2, 
and since 


where 


dao/ [Ni(a>i )] 2 

de,(x) an + (1 + aoi) cos WjT 


■ Mix, a>i ) 


dflu 

de,(x) 

dboi 

de,(x) 

db u 

de/(x) 


INiicot)] 2 
boi + bu cos ajj T + cos 2&>,■ T 
t D,(a>i)] 2 

b u + (1 + b 0l ) cosa>iT 


M(x, coj) 

■ M{x, a>i ) 


[Dtiwdf 


Mix, a>i ) 


1 


- — ■ Mix, u>:) 

3 H 0 H 0 

J and i = 1,2,..., K. Hence the gradient of e, (x), namely, Ve,- (x), can be formed, 
V|e, (x)| = sgn e, (x)Ve, (x) 


1 


if e/(x) > 0 
otherwise 


sgn e;(x) = 

V'f'/ fx) and V'hfx, \ k , % k ) can be evaluated using Eqs. (16.30) and (16.34), respectively. 


16.7.3 Stability 

The minimax algorithms considered will yield filters which may or may not be stable since the transfer 
function obtained may have poles outside the unit circle of the z plane. However, the problem can be 
easily eliminated by replacing the offending poles by their reciprocals and simultaneously adjusting 
the multiplier constant // (l so as to compensate for the change in gain. This stabilization technique 
is described in Sec. 11.4. 


16.7.4 Minimum Filter Order 

A problem associated with the design of filters with arbitrary amplitude and/or phase responses is 
that there are no known methods for the prediction of the filter order that will limit the approximation 
error to within prescribed bounds. However, satisfactory results can often be achieved on a cut-and- 
try basis by designing filters of increasing orders until the error is sufficiently small to satisfy the 
requirements. 
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16.7.5 Use of Weighting 

If x = x is a solution in the design of a recursive M-band filter, then the error at convergence, namely, 

e(x, w) — M(x, m) — M 0 (w) 

would tend to be uniformly distributed in the passband(s) and stopband(s) such that —5 < e(x. m) < 8 
in each and every band, where <5 is some positive constant. In such a design, the maximum passband 
ripple and minimum stopband attenuation would be given by 

1 +8 

A p = 20 log dB and A fl = -20 log <5 dB 
1 — 5 

respectively (see Sec. 9.4.6). In effect, the passband ripple would be correlated to the minimum 
stopband attenuation and a small or large passband ripple would be associated with a small or 
large minimum stopband attenuation. If the required specifications call for a passband ripple that 
is different from the stopband ripple, then by using a sufficiently large filter order one would be 
able to obtain a filter that just satisfies the required specifications with respect to the most critical 
band specification and oversatisfies the specifications in all the other bands. Such a design would, of 
course, be suboptimal with respect to the required specifications. 

The above problem can be circumvented through the use of weighting as was done in Chap. 15 
for the case of equiripple nonrecursive filters. The discretized error can be formulated as 

e,(x) = w nl [M(x, Mi) - M 0 (a>,)] 


where m = 1, 2, . .., M and from Eq. (16.29) or Eq. (16.31) a weighted objective function can 
be obtained. Minimization of the weighted objective function will result in a uniformly distributed 
weighted error such that —8 < e(x, w) < 8 and, therefore, the actual error in the various bands will 
be 

[M(x, Mi) - M 0 (Mi)\ = — 
w m 

for m = 1, 2,.. ., M. Thus if a band weighting constant w m is larger or smaller than unity, the actual 
band error will be reduced or increased relative to the value achieved without weighting. 

The required filter specifications can be readily used to calculate the required band errors 
Si, 82 ,... , 8 m and if we assume that an equiripple solution exists such that —5 < e(x, a>) < 8 , then 
at convergence we would have 

8 8 8 

8 1 = — 82 — — ... 8 m = - 

uq w 2 w M 

If we assume that a solution exists that would satisfy the required specification in the first band with 
a weighting constant w 1 = 1 , then the required weighting constants for the remaining bands can be 
deduced as 

<5i <5i <$i 

W2 = 7 - W 3 = — ... W M = — 

82 5 3 b M 

The use of this weighting scheme will result in a filter in which the band errors are in the correct 
proportion with respect to the specifications, and by using a sufficiently high filter order, all the 
specifications will be uniformly satisfied. In this way, it may be possible to find a lower-order 
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approximation that would satisfy the required specifications, which would translate into a more 
economical design. 


Example 16.3 


A lowpass digital filter is to be used in cascade with a D/A converter. The 
overall amplitude response from the input of the filter to the output of the D/A converter is 
required to be 


J 1.0 for 0 < u> < 4 x 10 4 rad/s 

\0.01 for 4.5 x 10 4 < co < 10 5 


and the amplitude response of the D/A converter is given by 


0(tt>) = 


sin(cur/2) 

oox/2 


where r is the pulse duration at the output of the D/A converter (see Sec. 6.10). Design the 
lowpass filter using Algorithm 7 first without and then with the nonuniform sampling technique 
of Sec. 16.6 and compare the results obtained. Use an eighth-order transfer function and assume 
that co s = 2 x 10 5 rad/s and r = T. 


■ Solution 

The amplitude response of the filter must be modified as [17] 

- j 1.0/</>(&>) for 0 < co < 4 x 10 4 rad/s 

L0) ~ jo.Ol/0(tu) for 4.5 x 10 4 < co < 10 5 

to achieve the required amplitude response between the input of the filter and the output 
of the D/A converter. 

The amount of computation required by optimization methods in general and the 
quality of the solution obtained tend to depend heavily on the initial solution assumed. 
If the initial point is close to the actual solution, the amount of computation tends to be 
low and the precision of the solution tends to be high. In this example, a good initial 
estimate of the solution can be obtained by designing an eighth-order lowpass filter with 
passband ripple A p — 0.1 dB, minimum stopband attenuation A a = 59.5 dB, passband 
edge u> p — 4.0 x 10 4 rad/s, and stopband edge co a = 4.5 x 10 4 rad/s. A lowpass filter that 
would satisfy these specifications can be readily designed using the method of Chap. 12. 
The transfer-function coefficients of a design based on the elliptic approximation are 
given in Table 16.3. 

Using Algorithm 7 with K = 40 (25 sample points in the passband and 15 in 
the stopband) first without and then with the technique of Sec. 16.6, designs A and B 
of Table 16.3 were obtained. The progress of the algorithm is illustrated in Table 16.4. 
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Table 16.3 Coefficients of H(z) (Example 16.3) 


j «<>/ 


«i/ 


hj 


by 


1 1.0 

Initial filter 2 1.0 

3 1.0 

4 1.0 


1.663591 2.964920£ - 1 -9.685886£ - 1 

4.646911£ — 1 5.578139£-1 -7.881536£ - 1 
-1.082131£ - 1 7.999954£ - 1 -6.314471£ - 1 
-2.936755£ - 1 9.452177£ - 1 -5.696838£ - 1 


H 0 = 1.3758142? — 2 


1 1.201422 

2 1.023690 

DesignA 3 9.871557£ - 1 
4 9.970934£ - 1 


1.802335 1.826366£ - 1 -7.094977 £ - 1 

5.173944£ - 1 4.754965 £ - 1 -6.411708£ - 1 

-9.208725£ - 2 7.562144£ - 1 -5.689563£ - 1 

-2.981699£ - 1 9.334971£ - 1 -5.428448£ - 1 


H 0 = 1.987973£ — 2 


1 1.255164 

2 1.048624 
Design B 3 1.003053 

4 1.000126 


1.822823 
4.620755£ - 
-1.109377E - 
-2.939426£ - 


1.916731 - 1 

1 4.905558E - 1 
1 7.657275E - 1 
1 9.349386E - 1 


—7.257967£ - 1 
—6.448195£ - 1 
-5.639906£ - 1 
—5.365697£ - 1 


H 0 = 2.000669£ - 2 


The magnitude of the error function for each of the two designs is plotted in Fig. 16.6a 
and b. As can be seen, spikes are present in the error function of design A but are entirely 
eliminated in design B through the use of the technique in Sec. 16.6. The amplitude 
response achieved in design B is illustrated in Fig. 16.7. 


Table 16.4 Progress of algorithm (Example 16.3) 



Design A 

Design B 

k 

£ \P(x, Ai,|t) 

£ *(x,A*,&) 


1 0.0 

2 7.510177£ — 4 

3 8.854903£ — 4 

4 9.013783£ — 4 

5 9.023167£ — 4 


7.509080£ - 6 
5.098063£ - 9 
6.874848£ - 11 
2.732611£ - 13 
2.371856£ - 15 


0.0 

7.510177£ — 4 
1.158158£ - 3 
1.250634£ - 3 
1.260096£ - 3 


7.509080£ - 6 
6.274917£ - 8 
3.401966£ - 9 
3.311865£ - 11 
4.468298£ - 14 
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Figure 16.6 Error |e(x, a>)\ versus a> (Example 16.3): (a) Without the technique of Sec. 16.6, 
(, b) with the technique of Sec. 16.6. 










Gain, dB Gain, dB 
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Figure 16.7 Amplitude response of lowpass filter (Example 16.3): (a) For 0 < a> < 10 5 , 
(b) for 0 < w < 4.1 x 10 4 . 
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Example 16.4 


Through the application of the singular-value decomposition, the problem of 
designing two-dimensional digital filters (see Sec. 18.6) can be broken down into a problem 
of designing a set of one-dimensional digital filters [18]. The amplitude responses of the one¬ 
dimensional filters so obtained turn out to be quite irregular and, consequently, their design 
can be accomplished only through the use of optimization methods. The amplitude response 
of such a filter is specified at 21 frequency points, as in Table 16.5, and co s = 2 rad/s. Obtain 
eighth-order designs using Algorithms 6 and 7 in conjunction with the nonuniform sampling 
technique of Sec. 16.6 in each case, and compare the results obtained. Assume that K = 35. 


Table 16.5 Specified amplitude response (Example 16.4) 


UJ 

Gain 

UJ 

Gain 

UJ 

Gain 

0.00 

1.0770 

0.35 

0.0304 

0.70 

0.7950 

0.05 

0.9863 

0.40 

0.1665 

0.75 

0.7950 

0.10 

0.9866 

0.45 

0.4402 

0.80 

0.7950 

0.15 

0.8428 

0.50 

0.6231 

0.85 

0.7950 

0.20 

0.8436 

0.55 

0.7471 

0.90 

0.7950 

0.25 

0.6466 

0.60 

0.7950 

0.95 

0.7950 

0.30 

0.3955 

0.65 

0.7950 

1.00 

0.7950 


■ Solution 


Using an initial point 

x= [1 1 0.75 1 1 1 0.75 1 1 -1 0.75 -1 1 -1 0.75 -1 if 

designs A and B of Table 16.6 were obtained. The progress of each algorithm is 
illustrated in Table 16.7. The maximum amplitude-response errors in designs A and 
B were 3.2675 x 10 2 and 3.5292 x 10 -2 . Evidently, Algorithm 6 gave a somewhat 
better design although the amount of computation time was nearly twice that required 
by Algorithm 7 in terms of function evaluations. The amplitude response achieved in 
design A is illustrated in Fig. 16.8. 


Table 16.6 Coefficients of H(z) (Example 16.4) 



j 

«0 j 

aij 

boj 


bij 



i 

1.002238 

2.482808 

—4.716961 £ - 

2 

—9.493371 E- 

1 


2 - 

-1.973023£ + 1 

1.880026E+ 1 

—2.123562E - 

1 

3.655407£ - 

1 

Design A 

3 

1.000000 

-8.468213E - 1 

1.496466£ - 

1 

1.873191E - 

2 


4 

1.830361 

-2.033032 

6.498825 E - 

1 

-1.155793 



Ho 

= 8.425338E - 

3 






1 - 

-1.260454E + 1 

3.977791 £ + 1 

4.318101E - 

1 

-1.055599 



2 

2.377913 

-2.490881 

—1.8311632? - 

2 

—5.216264£ — 

1 

Design B 

3 

9.849419E - 1 

—8.325620£ - 1 

3.616646E - 

1 

—2.230790E - 

1 


4 

5.511632E - 1 

—9.021266E - 1 

6.733342 E - 

1 

-1.088983 



Ho 

= 6.418782E — 

3 
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Table 16.7 Progress of algorithms 
(Example 16.4) 




Design A 


Design B 


k 

P 

*(x) 


€ 

>F(x, A*,&) 

1 

2 

7.106816F 

- 2 

0.0 

2.893164F 

-4 

2 

4 

3.726389 E 

- 2 

2.229626JS - 2 

4.092217£ 

-5 

3 

8 

3.329217F 

- 2 

3.397612JS - 2 

5.915443F 

-7 

4 

16 

3.757264F 

- 2 

3.527249£ - 2 

6.1844367? 

- 20 

5 

32 

3.472619F 

- 2 

3.174503£ - 2 

4.251311£ 

-5 

6 

64 

3.359927 E 

- 2 

- 

- 


7 

128 

3.304717£ 

- 2 

- 

- 




Figure 16.8 Amplitude response of one-dimensional digital filter (Design A, 
Example 16.4). 


16.8 DESIGN OF RECURSIVE DELAY EQUALIZERS 

The minimax algorithms described can also be applied for the design of recursive delay equalizers, 
as will now be demonstrated. Consider a filter characterized by the transfer function 


H f (z)=H 0 Y 


a 0j + a ljZ a 2jZ 
bo j +b\jZ + b 2 jZ 


2 


2 


(16.41) 
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The group delay of the filter is given by 


de F (w) 

r F {m) = --- 

dco 


where 


0 F (co) = arg H F (e J0>T ) 


From Eqs. (16.41) and (16.42), we can show that 


j 

r F (w) = -T ^ 
7=1 


T S-' 

Nj (<*>) tr 


Dj(o>) 

Dj(o>) 


(16.42) 


(16.43) 


(16.44) 


where 


Nj{co) = a\j — a,Qj + a\j{aij — aoj)cosa>T 

Nj(co) = (ci 2 j — aoj) 2 + a\j + 2a\j(a.2j + aoj)cos a>T + 4aojd2j cos 2 coT 
Dj(co) = b\j - blj + bij(b 2 j - b 0j )coscoT 

Dj{co) = (b 2 j - b 0j ) 2 + b\j + 2 b xj (b 2 j + b 0j ) cos cor + 4 b 0j b 2 j cos 2 coT 


The group delay of the filter can be equalized with respect to a frequency range an < a> < co F 
by connecting an allpass delay equalizer in cascade with the filter, as described in Sec. 12.5.1. Let 
the transfer function of the equalizer be 


M 

h E (z )=n 

7=1 


1 + CijZ + c 0j z 2 
COj + CijZ + z 2 


The group delay of the equalizer can be obtained as 


where 


r £ (c, a>) = - 


dd F {co) 

da> 


9e(c, co) = arg H E (e ja,T ) 


Hence 


M 

r £ (c, co) = 2T^2 
7=1 


Cjjco) 

Cj(co) 


(16.45) 
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where 

= 1 - clj + Cij(l - c 0 j) coscoT 

= (1 - Coy) 2 + c\j + 2c ly (1 + C 0 y) cos wT + 4c 0 y cos 2 0 )T 

and 


Cj{co) 

Cj{w) 


C = [coi c n C 02 C 12 ... C\m] T 

The equalizer is stable if and only if the transfer function coefficients satisfy the relations 

Coy <1 Ciy — Coy < 1 c ly + c 0j > ~ 1 

for j = 1, 2, ..., M as can be shown by using the Jury-Marden stability criterion (see Sec. 5.3.7). 
The region of stability in the (co, ci) plane is illustrated in Fig. 16.9. This may be referred to as the 
feasible region of the parameter space. 



Figure 16.9 Feasible region of (co, Ci) plane. 
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The group delay of the filter-equalizer combination can be expressed as 

r F£ (c, a) = r F (to) + t e (c, w) 

where rp {to) and r^(c, to) are given by Eqs. (16.44) and (16.45), respectively. 

The required equalizer can be designed by solving the optimization problem [13] 

minimize E(x) 

X 

where 

E(x) = max |e,(x)| 

1 <i<K 

1 

e;(x) = — r FE (x, tot) - r 0 



and 


to\ < to < o>l 

The problem can be readily solved by using Algorithm 6 or 7. As the solution is approached, variable 
to approaches the average of r fe / T with respect to the frequency band of interest, i.e., r approaches 
the average of r fe- 

The gradient of |e, (x)|, which is required for the evaluation of VT(x, A/., £/.), can be obtained, 
as in Sec. 16.7.2, by using the derivatives of e,(x), namely, 

de,(x) Uqi + U\i cos a>iT + U 21 cos 2 «,■ T + Uy cos 3 u >,• T 
dc 0 , = [C,(«,)] 2 

3 e,(x) Vo/ + Vi/coso),T + Vycos 2 co/T + Vy cos 3 «,■ T 
3ci, = [C,(®,)] 2 

9e,-(x) _ _ 1 
3r 0 

for / = 1,2, ..., M and ; = 1,2 ,..., K, where 

Uqi = 4[(1 - c 0 /) 2 - c 0 /c 2 ,] U u = -2ci/(l + 6c 0 / + Cq, + c 2 ,) 

U 21 = —8(l + Cq; + Cj/) C/ 3 / = —8ci/ 

Vo/ = —4ci/(l — co/)(l + Co/) V// = —2(1 — c 0 /)(l + 6co/ + Cg ? + c 2 /) 

V 2 / =0 Vy = 8(1 — Co/)co/ 

The quality of an equalizer is inversely related to the maximum variation of Tfe over the 
frequency band of interest. A measure that can be used to assess the quality of an equalizer design 
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can, therefore, be defined as 


where 


and 


100 (r F£ — x fe) 
2tfe 


r fe — max 

Xfe 

CO\ <0)<0)L 


r fe = min 

Xfe 

CO\ <0)<0)L 



(16.46) 


1 

Xfe — 2^ r FE + x FE ^ 


Alternatively, from Eqs. (16.46) and (16.47)) 


100 (r F £ — x fe) 
(x fe + x fe) 


(16.47) 


(16.48) 


As in the design of recursive filters, the application of Algorithm 6 or 7 for the design of 
equalizers may yield an unstable design. While it is possible to restore stability in such a design by 
replacing poles that are outside the unit circle of the z plane by their reciprocals, the group-delay 
characteristic of the equalizer will be changed and the resulting design will not be useful. A brute 
force approach to overcome this problem is to carry out several designs using different starting points, 
and then select the best design from the set of stable designs. An alternative and more methodical 
approach, which was found to give good results, is based on the following algorithm: 


Algorithm 8: Design of equalizers 

1 . Compute x F = (f F + f F )/2, where x F and f F are the maximum and minimum of the filter group 
delay, respectively. Assume a 1-section equalizer, and set j = 1 and x 0 i = (1 + k])x F /T , where k\ 
is a constant in the range 0 < &i < 0.5. Cany out designs using points 1 to 8 in Table 16.8 for the 
initialization of the equalizer coefficients until a stable design is obtained; let the coefficients of the 
stable design be c 0 1 and c n . Compute x FEl using Eq. (16.47). 


Table 16.8 Initialization points in the feasible region of the (c 0 , c{) plane 


No. 

Point 

No. 

Point 

No. 

Point 

1 

(0.3, 0.3) 

1A 

(0.25, 0.50) 

IB 

(0.50,0.25) 

2 

(0.7, 0.7) 

2A 

(0.50, 0.75) 

2B 

(0.75,0.50) 

3 

(0.7, 1.3) 

3A 

(0.50, 1.25) 

3B 

(0.75, 1.50) 

4 

(-0.3, 0.3) 

4A 

(-0.25, 0.50) 

4B 

(-0.50, 0.25) 

5 

(0.3, -0.3) 

5A 

(0.25, -0.50) 

5B 

(0.50, -0.25) 

6 

(0.7, -0.7) 

6A 

(0.50, -0.75) 

6B 

(0.75, -0.50) 

7 

(0.7, -1.3) 

7A 

(0.50, -1.25) 

7B 

(0.75, -1.50) 

8 

(-0.3, -0.3) 

8A 

(-0.25, -0.50) 

8B 

(-0.50, -0.25) 
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2. a. Increase the number of equalizer sections to two; set j = j + 1 and T 02 = tfei/T. 5 

b. Carry out designs using point (c 0 i, Cn) for the initialization of the first section and each of the 
points 

7*12 = [(1 — £i)coi. (1 — £i)cnl 
P 22 = [(1 + e l)c'OD (1 — ®l)Cll] 

P 22 = [(1 + e t)cot. (1 + e i)cii] 

P 42 = [(1 ~ £i)cqd (1 + £i)f'n] 


in turn for the initialization of the second section («! is a small positive constant). 

c. Compute parameter Q using Eq. (16.48). 

d. If the design obtained is successful, i.e., it is stable and has a Q which is significantly lower than 
that of the 1-section design, compute z FE2 and continue with step 3; otherwise, change £1 and 
repeat from step 2b. 

3. a. Increase the number of equalizer sections by one. Set j = j + 1 and To j = z F E{j-\)/T , and carry 
out designs using the most recent successful design for the initialization of sections 1 , 2 , ..., j — 1 
and point 




+ Coo—p), ^(ciG'-P + Cio-1)) 


for the initialization of the / th section where coo_p and Co(j-i) are the largest and smallest Co 
coefficients and c 1 ( j_u and c io_i) are the largest and smallest C\ coefficients in the most recent 
successful design. 

b. If the design obtained in step 3 a is unsuccessful, carry out designs using the most recent successful 
design for the initialization of sections 1 , 2 , .... 7 — 1 , and each of the points 

Pij = (coo-i). Cio-l)) 

P 2 j = (coo-i), Cl 0 _l)) 

P 3j = (C0O'-l)- Cl0_l)) 

P4j — (Coo-l)i C 10—1)) 


in turn for the initialization of the 7 th section. If a successful design is obtained, compute r fej 
and proceed to step 4; otherwise, stop. 

4. Compute Q\ if Q < <2 max , stop; otherwise, go to step 3a. • 


Extensive experimentation with Algorithm 8 has shown that for a given filter the solution 
points (coj ,cij) tend to form a cluster in the (co, ci) plane. Hence, once a stable 1-section design is 
obtained in step 1, the general domain of a multisection stable design is located. Consequently, as new 
sections are added in steps 2 and 3 one by one, a sequence of progressively improved stable designs 
are obtained. The logarithm of Q tends to decrease almost linearly with the number of equalizer 


5 The amount of computation can be reduced by using TfEj/T instead oftFEtj \)/T for tq j in steps 2 and 3; this 
modification can be readily incorporated in the algorithm by including the jth equalizer section in the calculation of zee 
using the initial coefficient values for the jth section. 
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sections at a rate that depends on the selectivity and passband width of the filter. In some examples, 
Q was found to reach a lower bound at some value less than 5 percent but the cause has not been 
identified. 

The optimizations required in steps 1 to 3 can, in principle, be carried out by using either 
Algorithm 6 or Algorithm 7. As in the design of recursive filters. Algorithm 7 tends to be much more 
efficient, while Algorithm 6 tends to yield better local minima (see Example 16.4). The advantages of 
the two algorithms can be combined by using Algorithm 6 in step 1, where a better design is highly 
desirable, and Algorithm 7 in steps 2 and 3, where computational efficiency is more important. 
Should Algorithm 7 fail to give a successful design in step 2 or 3, Algorithm 6 can be tried as an 
alternative. 

At the solution, parameter To tends to approach the average of t F e/T . A fairly good estimate 
of this quantity for the 1-section design, which can be used to initialize Toi, is obtained by letting 
Jfci = 0.50 in step 1. This value of k\ was found to give good results. 

For lowpass and highpass filters, points (coy, ciy) tend to form clusters in the fourth and first 
quadrant of the feasible region, respectively. Hence, only points 5 to 8 of Table 16.8 need be tried 
for lowpass filters and only points 1 to 4 need be tried for highpass filters. In the unlikely situation 
where none of these points gives a solution, points 1A to 8A and IB to 8B of Table 16.8 may be 
tried. 

For filters with moderate or high selectivity, the value of ei should be of the order of 0.01 or 
less; on the other hand, if the selectivity of the filter is low, a value as high as 0.1 may be necessary. 

In steps 2b and 3b, a rectangular domain is established in the parameter space, which encloses 
points (co;, Ci, ) for i = 1 , 2 , ... j — 1 , and each of the corner points P\j to P 4 y is used for the 
initialization of the jth section. Occasionally, one or two of these points may be located outside the 
feasible region of the parameter space and should not be used. 

2max in step 4 is the maximum allowable value of Q for the application at hand. If the number 
of sections is sufficient to reduce Q below Q max , the algorithm is terminated. 


Example 16.5 


The coefficients in Table 16.9 represent an elliptic highpass filter satisfying 
the following specifications: 


• Passband ripple A p : 0.5 dB 

• Minimum stopband attenuation A a : 50 dB 

• Passband edge co p : 0.75 rad/s 

• Stopband edge co a \ 0.64 rad/s 

• Sampling frequency u > s : 2.0 rad/s 


Table 16.9 Coefficients of H F (z ) (Example 16.5) 


j 

fl 0 j 

«!/ 

«2 j 

boj 

by, 

by 

1 

-1.0 

1.0 

0.0 

7.022673E - 

1 1.0 

0.0 

2 

1.0 

1.765666E — 2 

1.0 

6.452156F - 

1 1.351877 

1.0 

3 

1.0 

7.880299 £ - 1 

1.0 

8.893343F - : 

1 1.320853 

1.0 

H 0 

= 1.033262E — 2 
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Design a delay equalizer that will reduce the Q of the filter-equalizer combination to a value 
less than 1.0 percent. 

■ Solution 

The design was carried out using Algorithm 6 for step 1 and Algorithm 7 for steps 2 and 3, 
along with the nonuniform variable sampling technique of Sec. 16.6 in each case. In order 
to achieve the desired degree of flatness in the delay characteristic, it was found necessary 
to increase the number of equalizer sections to five. The progress of the design is illus¬ 
trated in Table 16.10. The transfer-function coefficients for the successive equalizers are 
given in Table 16.11. The delay characteristics of the filter-equalizer combination with 
no equalizer, a 2-section equalizer, and a 5-section equalizer are illustrated in Fig. 16.10. 

Table 16.10 Progress of design 
(Example 16.5) 


j 

(COji ^1 j') 

rFEj/T 

Q 

0 

— 

11.76 

66.38 

1 

(0.3, 0.3) 

16.21 

34.41 

2 

(0.6097, 1.482) 

20.16 

19.79 

3 

(0.7582. 1.610) 

26.47 

8.05 

4 

(0.7690, 1.579) 

32.85 

2.72 

5 

(0.7803, 1.567) 

39.08 

0.83 


Table 16.11 Coefficients of H E (z ) 
(Example 16.5) 


Sections j coj c\j 


1 1 6.158622E — 1 1.496936 


2 1 7.549257E-1 1.715040 

2 7.614137E- 1 1.504945 

1 7.552047E- 1 1.726392 

3 2 7.826521E — 1 1.431156 

3 7.668681£ — 1 1.634637 

1 7.703755E- 1 1.681226 

4 2 7.671458E- 1 1.551901 

3 7.945904E-1 1.391108 

4 7.659007E — 1 1.741710 

1 7.593030E — 1 1.692920 

2 7.602346E — 1 1.483221 

5 3 7.985100E — 1 1.365123 

4 1.551911E — 1 1.732325 

5 7.607868E — 1 1.610131 
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®, rad/s 

Figure 16.10 Delay characteristics of filter-equalizer combination (Example 16.5): 
-no equalizer,-2-section equalizer,.5-section equalizer. 


Example 16.6 


The coefficients in Table 16.12 represent an elliptic bandpass filter satisfying 
the following specifications: 


• Maximum Passband ripple A p : 1.0 dB 

• Minimum stopband attenuation A a : 40 dB 

• Low passband edge 0.3 rad/s 

• High passband edge w p 2 : 0.5 rad/s 

• Low stopband edge u> a \: 0.2 rad/s 

• High stopband edge co a i- 0.7 rad/s 

• Sampling frequency u > s : 2.0 rad/s 


Design a delay equalizer that will reduce the Q of the filter-equalizer combination to a value 
less than 2.0 percent. 


Table 16.12 Coefficients of H F (z) (Example 16.6) 


j a 0j 

a y 

cl -i 

b 0 j 

h \, 


b V 

1 -1.0 

0.0 

1.0 

1. 105797 E - 1 

—5.558010E- 

1 

1.0 

2 1.0 

-1.676442 

1.0 

8.610875E - 1 

— 1.312559E- 

2 

1.0 

3 1.0 

9.873155E - 1 

1.0 

8.856595E - 1 

-1.099622 


1.0 

H 0 = 2.602536 E - 2 
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■ Solution 

The design was carried out as in Example 16.5. In order to achieve the desired de¬ 
gree of flatness in the delay characteristic, it was found necessary to increase the 
number of equalizer sections to four. The progress of the design is illustrated in Ta¬ 
ble 16.13. The transfer-function coefficients for the successive equalizers are given in 
Table 16.14. The delay characteristics of the filter-equalizer combination with no equal¬ 
izer, a 2-section equalizer, and a 4-section equalizer are illustrated in Fig. 16.11. 


Table 16.13 Progress of design 
(Example 16.6) 


j 

( c 0ji c \j) 

tfEj/T 

Q 

0 

— 

11.95 

52.22 

1 

(0.3, 0.3) 

16.38 

27.78 

2 

(0.7332, -0.5297) 

23.19 

9.36 

3 

(0.7783, -0.7739) 

29.13 

3.31 

4 

(0.7469, -0.1775) 

32.44 

1.96 


Table 16.14 Coefficients of H E {z ) 

(Example 16.6) 

Sections 

j 

c o j 

C U 


1 

1 

7.405829 E - 1 

—5.245374 E - 

1 

2 

1 

7.814228E - 1 

-7.738830E - 

1 


2 

7.783450E - 1 

-2.892557E - 

1 


1 

7.621367E - 1 

— 1.775013E - 

1 

3 

2 

7.468771 E - 1 

—4.845243£ - 

1 


3 

7.925267E - 1 

-8.497135E - 

1 


1 

7.748554E - 1 

-2.501149£ - 

1 


2 

7.393927 E - 1 

-5.571269E - 

1 

4 

3 

7.930800E - 1 

-8.709362E - 

1 


4 

5.866017E - 1 

1.56669 IE - 

1 
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ft), rad/s 


Figure 16.11 Delay characteristics of filter-equalizer combination (Example 16.6): 
-no equalizer,-2-section equalizer,.4-section equalizer. 


The mechanism by which Algorithm 8 leads to a series of progressively improved 
stable designs is illustrated in Figs. 16.12 and 16.13. As can be seen in Figs. 16.12a 
and 16.13a, the error surface for the 1-section equalizer has a well-defined depres¬ 
sion in the feasible region of the parameter space which tends to be maintained as 
the number of equalizer sections is increased; see, for example, the error surface for 
the 4-section equalizer illustrated in Figs. 16.12£> and 16.13 b In effect, a natural bar¬ 
rier is formed around the solution that assures the stability of successive equalizer 
sections. 
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(b) 


Figure 16.12 3-D plots of error function (Example 16.6): (a) 1-section equalizer, ( b ) 4-section 

equalizer (the coefficients of the first three sections have been assumed to have the optimized 
values achieved in the 3-section equalizer). 
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Figure 16.13 Contour plots of error function (Example 16.6): (a) 1-section equalizer, ( b) 
4-section equalizer (the coefficients of the first three sections have been assumed to have the 
optimized values achieved in the 3-section equalizer). 
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PROBLEMS 

16.1. The step response y(t) of a digital filter is required to approximate the ideal step response 



for 0 < t < 2 
for 2 < t < 3 
for 3 < t < 4 
for 4 < t < 5 


where t = nT. Formulate a least-squares objective function for the solution of the problem. 

16.2. The quantity y should in theory be related to parameters X[ and x 2 by a formula of the form 


1 -j- d\X\ -b cl 2 X2 


In a specific experiment, the data in Table P16.2 were collected. Construct an objective function that can 
be used to find coefficients ao to a 2 such that the maximum difference between y and yo is minimized. 

Table P16.2 


*1 

*2 

IVo 

1 

1 

0.1265 

2 

1 

0.2193 

1 

2 

0.0075 

2 

2 

0.1262 

0.1 

0 

0.1859 


16.3. Obtain an objective function that can be used to find approximate values of x\ and x 2 that satisfy the 
relations 


jti = x\ — 3 log x\ 
x 2 = (2xj — 5xi + l) /x\ 


16.4. The so-called Rosenbrock function 


/(x)= 100 {x 2 -x\f + {\-xf> 2 
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16.5. 


16.6. 


16.7. 


16.8. 

16.9. 

16.10. 

16.11. 


16.12. 


16.13. 


16.14. 


represents a highly nonlinear surface in the shape of a narrow curved falling valley. It is often used to 
test the ability of algorithms to maneuver around curved valleys. Show that /(x) has a minimum at point 
[1 If. 

Find and classify the stationary points of function 


/(x) = x\ — x 2 + x\ — 2 x 1 X 3 — x 2 x 3 + 4*1 + 12 

(a) Show that the function 

f (x) — 2 xj — 2 x 1 x 2 4" x 2 4“ 2 x[ — 2x2 

has a minimum. 

(b) Find the minimum of the function using Algorithm 1 with x 0 = [0 0] 7 as initial point. 

Repeat Prob. 16.6 for the function 

/(x) = x 2 4- 2*2 4- 4xi 4- 4x 2 

Show that at point [1 4- Si, 1 4- £2]. where |ei| <$; 1 and |e 2 | 1, the Rosenbrock function given in 

Prob. 16.4 can be approximated by a quadratic function. 

Derive Eq. (16.27). 

Derive Eq. (16.28). 

(a) Show that the estimate of a 0 used in step 2d of Algorithm 5 (practical quasi-Newton algorithm), 
can be derived by using Eq. (16.27). 

( b ) Justify the use of cto = 1, if the estimate in part (a) is unreasonable. 

(a) Show that the extrapolation in step 6 of Algorithm 5 can yield a negative a 0 . 

(b) How is the problem in part (a) avoided. 

(c) In the interpolation as well as extrapolation routines of Algorithm 5, the search is aborted if the 
number of function evaluations exceeds a certain maximum. Why is it advisable to include such a 
termination criterion in optimization algorithms? 

(1 f) Explain the purpose of steps 4c, Ad, and 6c in Algorithm 5. 

Write a computer program for Algorithm 5 using the BFGS updating formula. 

(a) Use the program to obtain a least-squares solution of the problem in Prob. 16.1. 

(b) Repeat part (a) for the problem in Prob. 16.2. 

(c) Repeat part (a) for the problem in Prob. 16.3. 

(a) Use the program in Prob. 16.13 to minimize Rosenbrock's function given in Prob. 16.4. 

(b) Repeat part (a) for the function 

f(x) = 100[(x 3 - 10<9) 2 4- (r - l) 2 ] 4- xf 

where 


1 , 

f x 2 \ 


for 


> 0 

— tan 



Xl 

2 n 

\ X J 




0.25 



for 

Xi 

= 0 

1 

0.5 4- — 

tan -1 

(-) 

for 

Xl 

< 0 

2 n 


\XlJ 




and 


r = \J (xf + x\) 
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16.15. Use the computer program of Prob. 16.13 to minimize the following functions 

(a) 


/(x) = ( Xl + I0x 2 ? + 5(x 3 - x 4 f + (x 2 - 2x 3 ? + 100(xi - x,) 4 


(b) 


f(x) = ^ [I00(x,- - xl,) 2 + (1 - Xi ?] 

i= 2 


16.16. Write a computer program for Algorithm 5 using the DFP updating formula. 

(a) Use the program to obtain a least-squares solution of the problem in Prob. 16.1. 

(b) Repeat part (a) for the problem in Prob. 16.2. 

(c) Repeat part (a) for the problem in Prob. 16.3. 


16.17. (a) Run the computer program in Prob. 16.13 (BFGS version) with the function of Prob. 16.4 using 
10 different initial points and find the average number of function evaluations. Count one function 
evaluation for each evaluation of /(x) and one for each partial derivative of /(x). Repeat this process 
using the program in Prob. 16.16 (DFP version). Compare the results obtained. 

(b) Repeat part (a) with the function in part ( b ) of Prob. 16.15. 


16.18. Replace the line search in the computer program of Prob. 16.13 (BFGS version) by the line search 
described in Ref. [11] (see also second edition of Fletcher [6], pp. 34-35). 

(a) Use the program to obtain a least-squares solution of the problem in Prob. 16.1. 

(b) Repeat part (a) for the problem in Prob. 16.2. 

(c) Repeat part (a) for the problem in Prob. 16.3. 


16.19. (a) Run the computer program in Prob. 16.18 (different line search) with the function in Prob. 16.4 
using 10 different initial points and find the average number of function evaluations. Count one 
function evaluation for each evaluation of /(x) and one for each partial derivative of /(x). Repeat 
this process using the program in Prob. 16.13. Compare the results obtained. 

(b) Repeat part (a) with the function in part (b) of Prob. 16.15. 


16.20. Write a computer program for Algorithm 6 (least-pth minimax algorithm) using the BFGS updating 
formula. 


(a) Use the program to obtain a minimax solution of the problem in Prob. 16.1. 

( b ) Repeat part (a) for the problem in Prob. 16.2. 

(c) Repeat part (a) for the problem in Prob. 16.3. 

(d) Compare the minimax solutions obtained in parts (a) to (c) with the corresponding least-squares 
solutions obtained in Prob. 16.13 with respect to the minimum error achieved and the amount of 
computation required. 

16.21. Write a computer program for Algorithm 7 (Charalambous minimax algorithm) using the BFGS updating 
formula. 


(a) Use the program to obtain a minimax solution of the problem in Prob. 16.1. 

(b) Repeat part (a) for the problem in Prob. 16.2. 

(c) Repeat part (a) for the problem in Prob. 16.3. 

(d) Compare the minimax solutions obtained with Algorithm 7 with the corresponding solutions 
obtained with Algorithm 6 in Prob. 16.20. 

16.22. (a) Using the computer program in Prob. 16.20, design a fourth-order highpass digital filter with pass- 
band and stopband edges of 3.5 and 1.5 rad/s, respectively. The sampling frequency is required to 
be 10 rad/s. 


( b ) Repeat part (a) with the program in Prob. 16.21. 
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(c) Design an elliptic highpass filter that would satisfy the same specifications as the filter obtained 
in part (a) (i.e., same maximum passband ripple, minimum stopband attenuation, passband and 
stopband edges) using the closed-form method of Chap. 12. 

(d) Compare the designs obtained in parts (a) and ( b ), and (a) and (c). 

16.23. (a) Using the computer program in Prob. 16.20, design a sixth-order bandpass digital filter with passband 
edges 900 and 1100 rad/s, and stopband edges 800 and 1200 rad/s. The sampling frequency is required 
to be 6000 rad/s. 

(b) Repeat part (a) with the program in Prob. 16.21. 

(c) Design an elliptic bandpass filter that would satisfy the same specifications as the filter obtained 
in part (a) (i.e., same maximum passband ripple, minimum stopband attenuation, passband and 
stopband edges) using the closed-form method of Chap. 12. 

( d) Compare the designs obtained in parts (a) and ( b ), and (a) and (c). 


16.24. Modify the computer program in Prob. 16.20 using the nonuniform sampling technique in Sec. 16.6. Then 
use the program obtained to design a sixth-order lowpass filter with the idealized piecewise-continuous 
amplitude response 


Mo(a >) = 


f 0.545455a) +1.0 
\0.75w - 0.45 


for 0 < ai < 0.55 
for 0.60 < a> < 1.0 


The frequency range 0.55 to 0.60 rad/s represents a transition band in which the amplitude response is 
undefined. The sampling frequency is 2.0 rad/s. 

16.25. Modify the computer program in Prob. 16.21 using the nonuniform sampling technique in Sec. 16.6. 

(a) Use the program obtained to design the lowpass filter described in Prob. 16.24. 

(b) Compare the results with those obtained in Prob. 16.24. 

16.26. (a) Using the method in Chap. 12, design an elliptic bandpass filter that would satisfy the following 

specifications: 


• Maximum passband ripple A p : 1.0 dB 

• Minimum stopband attenuation A a : 30 dB 

• Low passband edge co p \\ 0.15 rad/s 

• High passband edge w P 2 '- 0.20 rad/s 

• Low stopband edge a>„i: 0.40 rad/s 

• High stopband edge co a 2 '- 0.50 rad/s 

• Sampling frequency co s : 2.0 rad/s 


(b) Design a bandpass filter with the same order and band edges as for the filter in part (a) by using the 
program in Prob. 16.24. The ideal passband and stopband gains can be assumed to be 1.0 and 0.01, 
respectively. 

(c) The bandpass filter in part ( b ) is to be used in cascade with a D/A converter. The amplitude response 
of the D/A converter cf>(cD) is of the form given in Example 16.3 with r = T. Using the program in 
Prob. 16.24, redesign the filter taking into consideration the amplitude response of the D/A converter. 
Use the coefficients of the filter in part (a) for the initialization of the algorithm. 

(i d) Repeat part (c) with the program in Prob. 16.25. 

16.27. (a) The amplitude response of a recursive filter is specified at 21 frequency points as in Table PI6.27 
and cd s = 2 rad/s. Obtain an eighth-order design using the program in Prob. 16.24. 
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Table P16.27 Specified amplitude response 


LO 

Gain 

UJ 

Gain 

UO 

Gain 

0.00 

0.9135 

0.35 

0.6232 

0.70 

0.5681 

0.05 

0.7080 

0.40 

0.7986 

0.75 

0.5725 

0.10 

0.6939 

0.45 

0.8186 

0.80 

0.5758 

0.15 

0.4062 

0.50 

0.7808 

0.85 

0.5780 

0.20 

0.3872 

0.55 

0.6598 

0.90 

0.5794 

0.25 

0.0070 

0.60 

0.5544 

0.95 

0.5802 

0.30 

0.2888 

0.65 

0.5623 

1.00 

0.5805 


(b) Design the filter in part (a) using the program in Prob. 16.25. 

16.28. (a) Using the method in Chap. 12, design an elliptic lowpass filter that would satisfy the following 

specifications: 

• Passband ripple A p : 1.0 dB 

• Minimum stopband attenuation A a : 40 dB 

• Passband edge a> p \ 0.10 rad/s 

• Stopband edge a> a : 0.15 rad/s 

• Sampling frequency a) s : 2.0 rad/s 

(b) Design a delay equalizer that will reduce the Q of the filter-equalizer combination to a value less 
than 5.0 percent using the computer program in Prob. 16.24. 

(c) Repeat part (b) using the program in Prob. 16.25. 

16.29. (a) Using the method in Chap. 12, design an elliptic highpass filter that would satisfy the following 

specifications: 

• Passband ripple A p : 1.0 dB 

• Minimum stopband attenuation A a : 60 dB 

• Passband edge a > p : 0.90 rad/s 

• Stopband edge a> a \ 0.85 rad/s 

• Sampling frequency co s : 2.0 rad/s 

(b) Design a delay equalizer that will reduce the Q of the filter-equalizer combination to a value less 
than 5.0 percent using the computer program in Prob. 16.24. 

(c) Repeat part ( b ) using the program in Prob. 16.25. 

16.30. (a) Design a delay equalizer for the filter in Prob. 16.26a that will reduce the Q of the filter-equalizer 

combination to a value less than 5.0 percent using the computer program in Prob. 16.24. 

(b) Repeat part (a) using the program in Prob. 16.25. 
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CHAPTER 

17 


WAVE 

DIGITAL 

FILTERS 


17.1 INTRODUCTION 

The effects of coefficient quantization in digital filters can be kept small by realizing the transfer 
function in terms of a cascade or parallel arrangement of second-order filter sections of the type 
described in Sec. 14.4. 

Alternative low-sensitivity structures can be obtained by using a synthesis methodology ad¬ 
vanced by Fettweis LI, 3] and developed further by Fettweis, Sedlmeyer, and others L4, 6]. In this 
approach, an equally terminated L C filter that would satisfy prescribed specifications is first designed. 
Then by replacing analog elements by appropriate digital realizations, the LC filter is transformed 
into a topologically equivalent digital filter. The synthesis is based on the wave network characteri¬ 
zation, and for this reason the resulting structures are referred to collectively as wave digital filters. 
The low sensitivity comes about because equally terminated LC filters are inherently low-sensitivity 
structures. 

The chapter begins with a qualitative justification of the low-sensitivity attribute of equally 
terminated LC filters. It then proceeds to the derivation of digital realizations for the various analog 
elements and then to the design and analysis details of structures based on LC lattice and ladder 
filters. An important advantage of wave digital filters is that they can be designed to be free of 
zero-input and overflow limit-cycle oscillations. This property of wave digital filters is demonstrated 
in Sec. 17.10. Later, in Sec. 17.12, an alternative cascade realization is developed by using the 
concept of the generalized-immittance converter. This approach yields filters with improved in-band 


773 


Copyright © 2006 by The McGraw-Hill Companies, Inc. Click here for terms of use. 




774 DIGITAL SIGNAL PROCESSING 


signal-to-noise ratio and leads to digital biquadratic multiple-output realizations that are amenable 
to very-large-scale integrated (VLSI) circuit implementation. 

17.2 SENSITIVITY CONSIDERATIONS 

An equally terminated LC filter like that in Fig. 17.1a can be characterized in terms of its insertion 
loss which is defined as 



R 



LC 



L{co) 



UfOi) 



A 


X i 


(c) 


Figure 17.1 (a) Equally terminated LC filter, (b) equiripple loss characteristic, (c) L(a>;) versus Xj. 
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P(a> ) is the actual output power and P m (a>) is the maximum output power under perfect matching 
conditions. Since the LC 2-port network (or 2-port for short) is a passive lossless network, P(a>) < 
P„ ,(&>) and thus L(w) > 0. Now let us assume that L(a>,) = 0 for i = 1, 2,..., as depicted in 
Fig. 17.1 b, as in the case of an elliptic characteristic. At frequency a>, the filter delivers the maximum 
available power, and if any lossless element xj is increased above or decreased below its nominal 
value Xj, Ha),) must necessarily increase above zero as illustrated in Fig. 17.1c. Clearly 

A L(a>i) dL{u>i) 

lira -= -= 0 

xj^Xj A Xj dxj 

for ; = 1,2, ... and j = 1,2, ... independently of the order of the filter [7]. Consequently, the 
sensitivity of the passband loss to element variations in equally terminated LC elliptic filters is 
inherently low. Therefore, by simulating filters of this type digitally, low-sensitivity digital-filter 
structures can be obtained. 

In Sec. 11.6, we have shown that a discrete-time transfer function Hd(z) can be readily obtained 
by applying the bilinear transformation 


s 


2 fz- 1 


T \z+ 1 


to a continuous-time transfer function Ha(s). It would, therefore, appear that one should be able 
to obtain low-sensitivity digital structures by simply applying the bilinear transformation to signal 
flow graphs of equally terminated LC filters. Unfortunately, this approach leads to flow graphs with 
delay-free loops which are not realizable (see Sec. 4.8.1). The problem is due to the fact that any 
realization of the bilinear transformation has a direct delay-free path between input and output. 

The problem of delay-free loops can be avoided in a somewhat circuitous manner by using the 
wave network characterization, as will be demonstrated in the next and subsequent sections. 


17.3 WAVE NETWORK CHARACTERIZATION 

An analog /V-port network of the form shown in Fig. 17.2a can be represented by the set of equations 


Ak — V k + h Pt 

Bk = Vk — hRk 


for k = 1,2,... ,N 


(17.1) 


The parameters Ak and If are referred to as the incident and reflected wave quantities, respectively, 
and Rk is the port resistance. The representation can be either in the time or frequency domain except 
that lower-case symbols are usually used for the time-domain representation. 

If two IV-ports are cascaded as in Fig. \12b, it is necessary to assign 


Rj = R k 
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Figure 17.2 (a) Analog IV-port network, ( b) interconnected A-ports. 


so that 


At = Bj and Aj = B/, 


i.e., a common resistance must be assigned to two interconnected ports to maintain continuity in the 
wave flow. Otherwise, Rt can be assigned on an arbitrary basis. 

An LC filter can be regarded as a conglomerate of a number of impedances (R, sL, or 1 / sC), 
a source (voltage or current), and a number of 3-port series and parallel wire interconnections 
as illustrated in Fig. 7.3. By realizing these elements digitally and subsequently replacing analog 
elements in LC filters by their digital realizations, wave digital filters can be synthesized. 
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Figure 17.3 (a) Impedance, (b) voltage source, (c) series wire interconnection, ( d ) parallel wire 

interconnection. 


17.4 ELEMENT REALIZATIONS 

Digital realizations for analog elements can be derived by using the following procedure: 

1. Represent the element in terms of the wave characterization. 

2. Eliminate variables 14, I k . and s, using the loop and node equations and the bilinear transfor¬ 
mation 


s 


2fz-\ 
T\z+ 1 
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3. Express the reflected wave quantities as functions of the incident wave quantities. 

4. Realize the resulting set of equations using unit delays, adders, inverters, and multipliers. 

17.4.1 Impedances 

Consider an impedance 

Z(s) = s x R x (17.2) 

where R x is a positive constant and a = — 1 for a capacitance, a = 0 for a resistance, and '/, = 1 for 
an inductance. From Eq. (17.1) and Fig. 17.3 a 

A=V + IR (17.3a) 

B = V - IR (17.3b) 


where 

V = IZ(s) 

and if the bilinear transformation is applied to continuous-time variables A, B. V, and /, that is, 


Q 


2 (z - 1 


T\z + 1 


Q 


(17.4) 


for Q = A, B,V, and /, we obtain 


B = f(z)A 


(17.5) 


where 


/(z) = 


Z(s) - R 
Z(s ) + R 



z — 1 


z + 1 


Now on choosing 



and then using Eqs. (17.2) and (17.6) we have 

! z~ l for a = — 1 
0 for X — 0 

—z _l for X — 1 


(17.6) 


(17.7) 


Hence Eq. (17.5) results in the element realizations of Fig. 17.4; that is, a resistance translates into 
a digital sink, a capacitance into a unit delay, and an inductance into a unit delay in cascade with an 
inverter. 
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Element R Realization Symbol 


R 


R 


o 


■o A 


o 


-o A 


T 

C 2C 



A o- 


B o- 


1L 



A o- 


B o- 



Figure 17.4 Digital realization of impedances. 

17.4.2 Voltage Sources 

For the voltage source of Fig. 17.3h, where 

Z(s) = s'R x 

we can write 

A=V + IR B=V - IR V = IZ(s ) + Vi 
and on eliminating V, I, and 5 we deduce 

B = f)(z)V, + f 2 (z)A 


2 R 

R + Z(s) 


and 


fi(z) = 


Z(s) - R 
Z{s) + R 



(17.8) 


where fi(z ) = 


_ 2 


z — 1 


z - 1 
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With 


f\ (z) and f 2 (z,) simplify to 


R = [ - 
T 


Rr 



1 

for k — — 1 



' z- 1 

for 


for X — 0 

and 

/2(Z) = < 

0 

for 

1 

for X = 1 



-z- 1 

for 


Hence Eq. (17.8) yields realizations for capacitive, resistive, and inductive sources, as depicted in 
Fig. 17.5. 


17.4.3 Series Wire Interconnection 

The preceding approach can be readily extended to the realization of wire interconnections. For the 
series interconnection of Fig. 17.3c 

h = h = h V\ + V 2 +V 3 = 0 


and on eliminating voltages and currents in Eq. (17.1), we can show that 

B = (I — M S )A 


where I is the 3x3 unity matrix, A and B are column vectors 


M s = 


m sl m s i m sl 
m s2 m s2 m s2 
m s3 m si m iS 3 


where m s3 — 2 — m s \ — m s2 


(17.9) 


and 


m sk = 


2 R k 

Ri + R 2 + Rt, 


for k =1,2 


(17.10) 


A realization of Eq. (17.9) is shown in Fig. 17.6 a. This can be referred to as type S2 adaptor, i.e., 
series 2-multiplier adaptor. 

With R 2 unspecified, one can choose 


7^2 — Ri + R 3 


so that 


m s 1 = 


Ri 1 

r 2 


m s 2 = 1 



Source 


R 


Realization 
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-o B 
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Figure 17.5 Digital realization of voltage sources. 
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S3 A3 



9 9 

-O 


Figure 17.6 Series adaptors: (a) Type S2 adaptor. 

according to Eq. (17.10). As a consequence, the above adaptor can be simplified to the series 
1-multiplier adaptor (type SI) of Fig. 17.6£>. 

17.4.4 Parallel Wire Interconnection 

Similarly, for the parallel wire interconnection of Fig. 17 3d, we have 

V, = V 2 = V 3 and h + h + h = 0 



and from Eq. (17.1) 


B = (M p — I )A 


(17.11) 


where 


M p 


m p 1 m p2 m p 3 
m p i m p2 m p 3 
in p 1 m p 2 m p 3 


with m p3 = 2 — in p i — m p2 


2 G k 

m ” k Gi+G 2 + G 3 


fork = 1,2 


(17.12) 
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b 3 a 3 




Figure 17.6 Cont’d Series adaptors: ( b ) Type SI adaptor. 


and Gk is the port conductance. A realization of Eq. (17.11), referred to here as type P2 adaptor, is 
shown in Fig. 17. la. The corresponding 1-multiplier realization (type PI adaptor) shown in Fig. 1 1 .lb 
is obtained by choosing the conductance at port 2 as 


C ?2 = G\ + G 3 


so that 


Gl i 

m p i = — m p 2 — 1 

Cr 2 


Adaptors S2 and P2 are said to be unconstrained since their port resistances can be assigned 
arbitrary values. 


17.4.5 2-Port Adaptors 

Unconstrained 2-port adaptors can be obtained by modifying series or parallel 3-port adaptors. By 
letting A 3 = G 3 = 0 and deleting the terminal for /I 3 in the parallel adaptor of Fig. 17.7a, the 2-port 
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1 


2 



3 



6 4 

(a) 

Figure 17.7 Parallel adaptors: (a) Type P2 adaptor. 


adaptor depicted in Fig. 17.8a can be obtained. From Eq. (17.12) 


m p i - 1 = —(m p 2 - 1) 


and hence the number of multipliers in the adaptor can be reduced to one, as shown in Fig. 17.8 b. 
The value of multiplier constant /i is given by 


M = m p 2 - 1 = 


G 2 — G\ 
G 2 + G\ 


Alternative adaptor configurations can be found in [8, 9]. 


17.4.6 Transformers 

The above principles can be used for the derivation of digital equivalent networks for 2-port devices 
such as transformers, gyrators, and circulators. For example, the ideal transformer of Fig. 17.9a can 
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Figure 17.7 Cont’d Parallel adaptors: (b) Type PI adaptor. 


be represented by the relations 


V 2 = kVi I 2 — ~h/k 


where k is the turns ratio. On assigning resistances R i and R 2 to ports 1 and 2, respectively, we can 
show that 


B = \ I / A 


(17.13) 


where 


My = 


mil mu 

m 2 i 11122 . 
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Figure 17.8 (a) 2-port adaptor, (b) 1 -multiplier version. 


with 


m it 


m 2i 


R 2 -k 2 Ri 
R 2 + k 2 Ri 
2k R 2 

R 2 +k 2 Ri 




m 22 


2kR t 

R 2 + k 2 Ri 
R 2 - k 2 R\ 
R 2 + k 2 Ri 


A realization of Eq. (17.13) is shown in Fig. 11.9b. If we assign R 2 = k 2 R\, then mn — 0, 
m \ 2 = 1 /k, m 2 \ = k, and m 22 = 0 and the simplified realization of Fig. 17.9c is obtained. 


17.4.7 Unit Elements 

Another 2-port element which is often quite useful is the so-called unit element. This device simulates 
a transmission line of delay T /2 and characteristic impedance R, and it has been used extensively in 
the design of microwave filters. It can be represented by the symbol of Fig. 17.10« and is characterized 
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v i 




v 2 


(a) 




Figure 17.9 ( a ) Ideal transformer, ( b ) digital realization, (c) simplified version, 

by the equations 

Vi = k n V 2 — knh 
h = k-2i V 2 — kxih 


where 


K = 


kn kn 

1 

1 sR 

A'21 k 2 2 

Vl — s 2 

s/R 1 


(17.14a) 

(17.14b) 

(17.15) 


with s — sT/ 2. K is said to be the chain matrix of the 2-port. On assigning port resistances 


Ri = R2 = R 
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(a) 


A, o- 


B, o- 
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Figure 17.10 (a) Unit element, ( b ) digital realization. 

and then expressing B\ and Bi in terms of A ] and A 2 using Eqs. (17.1), (17.4), and (17.14), we 
obtain 


B\=z 1 A 2 
B 2 = z~' J Ai 

Therefore, a digital realization of the unit element can be obtained as shown in Fig. 17.10Zz. 

17.4.8 Circulators 

Circulators are /V-port devices with N > 3 in which the reflected wave at a given port is equal to 
the incident wave at the adjacent port, say, in the counterclockwise direction, i.e., 

B\ = A n B 2 — A, • • • B n = A w _! 

A 3-port circulator and its digital realization are illustrated in Fig. 17.11a and \1 Alb. Circulators, 
like unit elements, are used in the design of microwave circuits and filters but, as will be shown in 
Sec. 17.5, they can also be used in the design of an important class of wave digital filters known as 
lattice wave digital filters. 

17.4.9 Resonant Circuits 

Wave digital filters are sometimes designed as simple interconnections of series or parallel resonant 
circuits. Digital realizations for circuits of this type can be readily obtained by using the principles 
described so far. For example, a series resonant circuit comprising a capacitor C and an inductor L 
can be drawn as shown in Fig. 17.12a and on assigning the port resistances 


R 2 = T/2C and R 2 = 2L/T 
















WAVE DIGITAL FILTERS 


789 



^1 



V 


-° #3 


B x o-«*-«—o A 3 
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Figure 17.11 (a) 3-port circulator, (b) digital realization. 
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Figure 17.12 (a) Series resonant circuit, ( b ) digital realization using a 3-port adaptor. 
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(a) 



(b) 

Figure 17.13 (fl) Series resonant circuit using a unit element and a capacitor, ( b ) digital realization. 


the digital realization of Fig. 17.12b is obtained. 

An alternative realization of a series resonant circuit can be derived by using a unit element 
terminated by a capacitor, as depicted in Fig. 17.13 a. From Eqs. (17.14) and (17.15), the input 
impedance of the circuit can be deduced as 


Z, 


1 

Y 3 



(17.16) 


where 


Ki = ^-R 0 T K 2 = Co and K, = 1 + — Z — 
Z ZKqCq 


Now if we assign 


Ro = 


4 LC 


2TC 


and 


C 0 = 


4LC 2 


4 LC + T 2 


Eq. (17.16) assumes the form 


Z, — sL + — 
sC 

i.e., the network realizes a series resonant circuit. On assigning conductances Gi = \/Rq and 
Go = 2 Cq/T to ports 1 and 2 of the wire interconnection and then replacing the analog elements by 
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their digital counterparts, the digital realization of Fig. 17.1 3b is obtained; the multiplier constant of 
the 2 -port adaptor can be expressed as 

G 2 -Gi ALC-T 2 
11 ~ G 2 + G 1 “ ALC + T 2 


17.4.10 Realizability Constraint 

Digital networks containing delay-free loops are said to be unrealizable because certain node signals 
in such networks cannot be computed (see Sec. 4.8.1). The networks derived so far do not contain 
delay-free loops. However, such can arise if adaptor ports with direct paths are interconnected. 
The only adaptor port without direct paths is port 2 in adaptors SI and PI, as can be seen in 
Figs. 17.6Z? and 17.7/;. Therefore, for the sake of realizability, every direct connection between 
adaptor ports must necessarily involve port 2 of either an SI or a PI adaptor. 

17.5 LATTICE WAVE DIGITAL FILTERS 

With digital realizations available for the various analog elements, several families of wave digital 
filters can be obtained by converting classical lattice, ladder, microwave, active, and other types 
of analog filters into digital filters [1], [4-6], [9-12], In this and the next section, we examine the 
realization of lattice and ladder digital filters. 

The class of wave lattice digital filters is based on the lattice network shown in Fig. 17.14 a 
where Z A and Zb are usually canonic, lossless, LC impedances (see Refs. [1-3] of Chap. 10). 

17.5.1 Analysis 

Like any other 2-port network, the lattice network of Fig. 17.14a can be represented by the wave 
characterization of Eq. (17.1). Applying Kirchhoff’s laws to the network yields 

h = ^-(Vi + v 2 ) - h 

Zb 

j = 2F 2 + (Z A - Z B )I | 

Z A + Zb 

and on assigning port resistances R l — R 2 — R and then eliminating f \, I 2 , V\ , and V 2 in Eq. (17.1), 
we obtain 


B = SA 


where 


6 'i 1 S \2 
S21 S22 


(17.17) 


(17.18) 


with 


Sn — S 22 — ( Sb + S a )/2 
S 12 — S 21 = (Sb — Sa )/2 


(17.19a) 

(17.19b) 
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Figure 17.14 (a) Analog lattice network, ( b ) alternative realization based on wave characterization. 




Sb 


Z a -R 
Za + R 
Z b -R 
Zb + R 


(17.20a) 

(17.20b) 


17.5.2 Alternative Lattice Configuration 


From Eqs. (17.17)—(17.19), we can write 

B X = ^[S a (A, -A 2 ) + 5 B (ri 1 +A 2 )] 

B 2 = \[Sa(A 2 -A 1 )+S b (A 1 + A 2 )] 

Thus an alternative analog realization for the lattice network can be derived, as depicted in Fig. 17.14 b, 
where networks Na and /V/j realize Sa and .S'«, respectively. With port 2 of the network in Fig. 17.1 4a 
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Figure 17.14 Cont’d (c) Simplified configuration. 

terminated by a resistance R, we have A 2 = 0 and hence, the simplified configuration of Fig. 17.14c 
is obtained. The transfer functions of the configuration from input to outputs B\ and B 2 are given by 

H a (.s) = ^ = S n = + S A ) (17.21a) 

A i 2 

H A (S) =^ = S 2l = - S A ) (17.21b) 

A \ 2 

If Z A and Z B are assumed to be lossless LC impedances in order to achieve the low-sensitivity 
property described in Sec. 17.2, then for s = jco they assume imaginary values and, therefore, from 
Eq. (17.20) 

|S A | = |S B | = 1 for all w 


i.e., S A and S B are allpass transfer functions. 

A lattice analog filter can be designed by expressing its transfer function as the difference of 
allpass transfer functions S A and S B , as in Eq. (17.21b), and then realizing these transfer functions. 
We shall now consider these tasks in the reverse order. 

An allpass transfer function of the form 

B Z(s) - R 

S = - = —-- 

A Z(s) + R 

can be realized either directly as an allpass network or indirectly by realizing impedance Z (.v) and 
then applying the wave characterization, as can be seen from Eq. (17.3). An arbitrary LC impedance 
can be realized in terms of the classical Foster or Cauer forms (see Refs. [1-3] of Chap. 10) or a 
combination of the two or by a cascade arrangement of unit elements [9]. Consequently, a large 
variety of realizations are possible for S A and S B . 

The design effort can be kept to a minimum by realizing S A and Sn in terms of cascade 
arrangements of first- and second-order allpass sections which can be realized by simple reactances 
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or resonant circuits. Thus, an arbitrary allpass network represented by 


K 


s=n» 

i=l 


can be realized by the cascade arrangement illustrated in Fig. 17.1 5a. Now if the return path from A 2 
to B\ is included as shown and the port resistances are assumed to be R throughout, an LC network 
realizing S can be obtained as illustrated in Fig. 17.15ft. 

Let us now consider the decomposition of the required transfer function into a difference of 
two allpass transfer functions, as in Eq. (17.21b). If we let 


5a 


Sb 


d A {s) 

d B (-s) 

dfi(s) 


S 11 


S 21 


~(S B + Sa ) 
- S A ) 


M(s ) 

ms) 

D(s) 


(17.22a) 

(17.22b) 

(17.23a) 

(17.23b) 


where d A (s) and d B (s) are Hurwitzpolynomials (see Refs. [1-3] of Chap. 10) of degree N 1 and AL, 
respectively, with N\ odd and N 2 even, then Eqs. (17.22) and (17.23) give 


D(s) = d A (s)d B (s) 

1 

-[d A (s)d B (-s) - d A (-s)d B (s)] = M{s) 

and 

1 

-[d A (s)d B (-s) + d A (-s)d B (s)] = N(s) 
where D(s ) is of degree N with N odd. Hence 

d A (s)d B (-s) = M(s) + N(s) (17.24) 


For Butterworth, Chebyshev, inverse-Chebyshev, and elliptic lowpass filters, the factorization 
of Eq. (17.24) exists. Furthermore, it can be easily obtained by using a technique due to Rhodes [13], 
as will now be shown. If the denominator of the transfer function is expressed as 

(Af+l )/2 

D(s) = (s + p\) (s + pi)(s + pf) 

i=2 

where p\ is real and 3m p, > 3m 1 > 0 for i = 2, 3,..., (N + l)/2, then the factorization in 
Eq. (17.24) can be carried out by assigning poles with odd index to d A (s) and poles with even index 
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( 4 ) 


Figure 17.15 (a) Realization of transfer function S, ( b ) corresponding LC network, (c) digital realization of 

first-order allpass network, (d) digital realization of second-order allpass network. 
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to d B (s), that is, 


d A (s) = (>v + Pl )(s + p 3 )(s + pi) ■ ■ • (17.25a) 

d B (s) = (s + p 2 )(s + p* 2 )(s + P4)(s + pi) • • • (17.25b) 

For the aforementioned types of filters, the transfer functions // 4 (,v) and H A (s ) satisfy the 
so-called Feldkeller equation [10] given by 

\H A (ja))\ 2 + \H A {jco)\ 2 = 1 


Consequently, if H A (s) represents a lowpass filter such that 


then 


HAe ju>T ) 


for 0 < |«| < cop 
otherwise 


H A {e ja)T )» 


for co p < \o)\ < co s /2 
otherwise 


(17.26) 


and vice versa. In effect, the configuration of Fig. 17.14c realizes simultaneously a lowpass and a 
highpass filter whose frequency responses are complementary. The structure finds applications in 
the design of quadrature mirror-image filter banks (see Sec. 18.3). 


17.5.3 Digital Realization 

Given a lowpass transfer function of the form 


Ha(s) = 


_ ms) _ 

(s + hoi) n:=2 +1)/ V + bus + b 0i ) 


allpass sections characterized by 


Hds) = 


-s + h 0 i 
s + hoi 


and 


H,(s) = 


s 2 - bus + b 0 i 
s 2 + b u s + b 0 i 


are required. II\(s) can be expressed as 


Hi(s) = 


Z(s) - R 
Z(s) + R 


(17.27) 


(17.28) 


where Z(s ) = Rb<i\ /s is the impedance of a capacitor. It can, therefore, be realized by a 2-port 
adaptor with a multiplier constant 

2 - Thpi 

2 + T hoi 


Mil = 


(17.29) 
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terminated by a unit delay, as depicted in Fig. 17.15c. Similarly, Hj(s) can be put in the form of 
Eq. (17.28) with 


Z(s) = 


Rs 

bu 


R hoi 

sbn 


In this case, Z(s) represents a series resonant circuit with L — R/bu and C = bu/Rho ,. A realization 
of Hj(s) can, therefore, be obtained as shown in Fig. 17.15c/ by using the structure of Fig. 17.1 3b. 
The bottom adaptor is used to match the port resistance of the resonant circuit to that of the circulator. 
The multiplier constants of the two adaptors are given by 


= 4 - T 2 b 0i 
4 + T 2 b 0i 


(17.30a) 


and 


2Tb h - T 2 b 0i - 4 
2 Tb u + T 2 b 0i + 4 


(17.30b) 


for i =2, 3,...,(N+ l)/2. 

A transfer function of the form given by Eq. (17.27) can be realized in terms of a wave lattice 
structure by using the following procedure: 

1. Carry out the decomposition in Eq. (17.24) as in Eq. (17.25) using the technique described. 

2. Form the allpass transfer functions Sa and Sb as in Eq. (17.22). 

3. Realize the allpass sections obtained in (2) using the structure in Fig. 17.15c for the first-order 
section and the structure of Fig. 17.15c/ for second-order sections. 

4. Form the digital realizations of networks Na and N H and connect them as in Fig. 17.14c. 


The transfer function of the digital filter obtained is given by Eq. (17.21b) as 


H d (z) = H a (s) 


2(z-l 


T\z+ 1 


Example 17.1 


function 


Obtain a lattice realization for the fifth-order Butterworth lowpass transfer 


H a (s ) = 


1 

(s + l)(s 2 + 0.6180345 + l)(x 2 + 1.618034X + 1) 


Assume that co s = 2i r. 
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■ Solution 


The polynomials + 4 (.$) and ds(s) are given by 

d A (s) = (s + l)(s 2 + 0.6180345 + 1) 
d B (s) = s 2 + 1.618034i+ 1 


Hence 

c (-5 + 1)(5 2 - 0.6180345 + 1) 

a(iS ° “ ( 5 + 1)(5 2 + 0.6180345 + 1) 

5 2 - 1.6180345 +1 

Sr(s) — —- 

5 2 + 1.6180345 +1 

With a> s = 2: r, we have T = Is; on using Eqs. (17.28)—(17.30), the multiplier constants 
of the adaptors can be computed as /xn =0.333333, /x 12 = 0.60, /x 22 = — 0.214172, 
/x 13 = 0.60, and /x 23 = —0.603575. The realization obtained is shown in Fig. 17.16. ■ 



Figure 17.16 Lattice realization of Butterworth lowpass filter (Example 17.1). 


17.6 LADDER WAVE DIGITAL FILTERS 

Although lattice filters are easy to design and have low sensitivity to coefficient quantization at 
passband frequencies, the sensitivity at stopband frequencies can be quite high. This is due to the 
fact that transmission zeros (frequencies of zero gain) are achieved by the exact cancellation of the 
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signals through networks N A and N B . A class of wave digital filters in which the sensitivity is low 
at passband as well as stopband frequencies can be obtained by realizing the 2-port in Fig. 17. la in 
terms of an LC ladder network [13-17] and then applying the wave characterization. The following 
design procedure can be employed. 

1. Identify the various series and parallel wire interconnections in the LC filter and number the 
ports such that every direct connection between wire-interconnection ports involves a port 2. 

2. Assign port resistances to the wire-interconnection ports. For a port terminated by an impedance 
s l R x or by a voltage source with an internal impedance s k R x assign a port resistance (2/T) x R x . 
Then choose the unspecified port resistances to give as far as possible type SI and PI adaptors, 
ensuring that a common resistance is assigned to any two interconnected ports. 

3. Calculate the multiplier constants for the various adaptors. 

4. Replace each analog element in the LC filter by its digital realization. 

The transfer function of the filter obtained is given by 


B~> A 0 

, = (17.31) 

Ai B, 

where A a is the incident wave quantity for the output resistance and B, is the reflected wave quantity 
for the input source. From Eqs. (17.3)—(17.6), and (17.8), we obtain B, = V, and A a = 2V 0 and so 
Eq. (17.31) yields 


H d (z) = 2 H a (s) 


2 

s= — 

T 


z + 1 


where H A (s ) is the transfer function of the analog filter. 


Example 17.2 


specifications: 


Figure 17.17a represents an elliptic lowpass filter satisfying the following 


• Maximum passband loss: 1.0 dB 

• Minimum stopband loss: 34.5 dB 

• Passband edge: V0.5 rad/s 

• Stopband edge: 1/V0.5 rad/s 

The element values of the filter are 


Ci = C 3 = 2.6189 F C 2 = 0.31946 F L 2 — 1.2149 FI R = 1 Q 
Derive a corresponding wave digital filter using a sampling frequency of 10 rad/s. 

■ Solution 

The wire interconnections can be identified as illustrated in Fig. 17.17b. Fet Gjk ( Rjk ) 
represent the port conductance (resistance) assigned to the jth port of the kth wire 
interconnection. From step 2 of the above procedure the following assignments can be 
made: 
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l 2 



1-2 



(b) 

Figure 17.17 (a) Elliptic lowpass filter (Example 17.2), ( b ) identification of wire 

interconnections. 


Interconnection 1: 


1 

G ii = - 
R 

G31 = 

11 

1 

MO 

G21 = 

= Gn + G31 

m p 1 = 

0.107110 

Interconnection 4 : 







T 

G 14 = - 

2 L 2 

G34 

_ 2 C 2 

~~ T 

G24 

= G14 + G34 

m pl = 

= 0.202741 

Interconnection 2 : 







1 

R 12 = - 

iz. 

^21 

R32 

1 

G24 

R22 

= R12 + R32 

m si = 

0.120194 
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(c) 

Figure 17.17 Cont’d (c) Wave digital filter. 


Interconnection 3: 


G 



G23 = 


1 

~R 


G 33 = 


2 C 3 

~Y~ 


m p 1 = 0.214595 m p2 = 0.191234 


Interconnections 1, 2, 3, and 4 result in PI, SI, P2, and PI adaptors, respecti¬ 
vely, as depicted in Fig. 17.17c. The multiplier coefficients can be computed by using 
Eqs. (17.10)—(17.12). ■ 


The realization of Fig. 17.17c is one of a large number of possibilities since the assignment of 
port resistances to wire interconnections is not unique and one may realize the resonant circuits using 
unit elements and capacitors or inductors instead of 3-port adaptors, capacitors, and inductors (see 
Figs. 17.12 and 17.13). Furthermore, alternative realizations can be obtained by viewing the 2-port 
ladder network as a cascade connection of elemental 2-ports which can be realized individually 
[18, 19]. While many of these structures may appear to be equivalent in terms of computational 
complexity, frequently there are important practical considerations that may favor one or the other 
type of structure, depending on the application at hand. Topological constraints necessitate that one 
of the adaptors in a ladder digital filter be of the unconstrained type (i.e., of type S2 or P2). Increased 
speed of operation and signal-to-noise ratio can often be achieved by assigning port resistances such 
that an unconstrained adaptor is obtained at the center of the structure, e.g., for interconnection 2 of 
the filter in Fig. 17.17b. There are many other issues involved in the design of wave digital filters, like 
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their VLSI implementation and the compensation for parasitic delays that arise in practical circuits. 
These issues and many others are considered in some detail by Fettweis [9]. 1 

It should be mentioned that the numbers of delays and adders in ladder wave digital filters can 
sometimes be reduced somewhat by employing a pair of impedance transformations first used by 
Bruton [20] in the domain of active filters. In these transformations, each impedance Z(s) in the analog 
filter is replaced by sZ(s) or Z(s)/s. In the first case, impedances R x , R x /s, and sR x are replaced 
by impedances sR x , R x , and s 2 R x , that is, resistances translate into inductances, capacitances into 
resistances, and inductances into ,y 2 -impedance elements. With ,v = jco , we have .v 2 = —or, that is, an 
,v 2 -impedance element behaves as a frequency-dependent negative resistance (FDNR) and for this 
reason the transformed network is often referred to as an FDNR network. With this transformation, 
filters with a large number of capacitances and a small number of inductances, e.g., minimum 
inductance lowpass and highpass filters, translate into filters with a large number of resistances and 
a small number of .v 2 -impedance elements. Since the digital equivalents of resistances are simple 
sinks, the FDNR filter leads to a somewhat more economical digital design [21]. 


17.7 FILTERS SATISFYING PRESCRIBED SPECIFICATIONS 

In lattice as well as ladder digital filters, the wave quantities are transformed using the bilinear 
transformation (see Eq. (17.4)) and, therefore, the filters obtained, like other filters based on the 
bilinear transformation, are subject to the warping effect discussed in Sec. 11.6.3. 

Wave digital filters that would satisfy prescribed specifications can be designed by using the 
prewarping techniques of Chap. 12. A detailed design procedure is as follows: 

1. Using the specifications, derive an appropriate normalized lowpass transfer function according 
to steps 1 to 3 in Sec. 12.4. 

2. Realize the transfer function derived in step 1 as an equally terminated LC lattice or ladder filter. 

3. Transform the lowpass filter realized in step 2 using the appropriate formula in Table 12.1. 

4. Form the desired digital filter using the procedure in Sec. 17.5 or 17.6. 

For the case of ladder filters, step 2 can be carried out by using filter-design tables like those 
found in Skwirzynski [14], Saal [15], and Zverev [ 16] or by using one of several available filter-design 
software. 2 


Example 17.3 


cations: 


Design a wave bandpass digital filter that would satisfy the following specifi- 


• Maximum passband loss: 1.0 dB 

• Minimum stopband loss: 35.0 dB 

• Lower and upper passband edges: 2.0 and 3.0 rad/s 

• Lower and upper stopband edges: 1.5 and 3.5 rad/s 

• Sampling frequency: 10 rad/s 


1 This paper includes, in addition, a fairly long list of references on the subject. 

2 See Circuit Sage at http://www.circuitsage.com/filter.html. 
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■ Solution 

On choosing an elliptic approximation and then using the procedure in Sec. 12.4, we 
obtain 

n = 3 k = 0.4472136 co 0 = 3.183099 B = 3.093133 

where n and k are the order and selectivity factor of the normalized lowpass filter, 
respectively, and o>o and B are the parameters in the transformation 



A normalized lowpass LC filter with n = 3 and k = 0.45 can be obtained from 
Ref. [14] as depicted in Fig. 17.17a, where we now have 

Ci = C 3 = 2.8130 F C 2 = 0.26242 F L 2 = 1.3217 H R = lfi 

On applying the above lowpass-to-bandpass transformation, the bandpass filter of 
Fig. 17.18a can be formed, where 

L\ = L\ = 0.108525 H C\ =C\ = 0.909434 F 

L' 2 = 0.427301 H C' 2 = 0.230975 F 

L' 3 = 1.16333 H C 3 = 0.0848396 F 
R = 1 Q 


Table 17.1 Multiplier constants 
(Example 17.3) 


Adaptor 

Type 

k 

m p k or m sk 

1 

PI 

1 

0.256751 

2 

PI 

1 

0.573642 

3 

SI 

1 

0.117926 

4 

PI 

1 

0.216662 

5 

P2 

1 

0.973738 



2 

0.263494 

6 

PI 

1 

0.702492 

7 

PI 

1 

0.576495 

8 

SI 

1 

0.500000 
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Lj ^2 




(b) 

Figure 17.18 (a) Bandpass elliptic filter (Example 17.3), ( b ) wave digital filter. 


Subsequently, on using the procedure of Sec. 17.6, the wave digital filter of Fig. 
17.18£> can be derived. The resulting multiplier constants are given in Table 17.1. The 
loss characteristic achieved is plotted in Fig. 17.19. ■ 


































































































WAVE DIGITAL FILTERS 805 



Figure 17.19 Loss characteristic of a bandpass filter (Example 17.3). 


17.8 FREQUENCY-DOMAIN ANALYSIS 


Once a wave digital filter is designed, a frequency-domain analysis is often necessary to study 
quantization effects or simply to verify the design. Such an analysis will now be described. 

Consider the network in Fig. 17.20a, where adaptor q is terminated by subnetworks N p , N r , 
and N s . Adaptor q can be characterized by 


H q {z) = 


Ihq 

At q 


F lq = 


B 


q 


F 2q = 


B 2 q 

A 2 q 


H q (z ) is the transfer function of the terminated adaptor, and F\ q and F 2q are its input functions at 
ports 1 and 2, respectively. Similarly, subnetworks N p , N r , and N s can be characterized by the input 
functions 


F P = 



Al q 

Blq 



Bs A3 q 
A s B 2q 


Expressions for H q (z), F lq , and F 2q in terms of F p , F r , and F s for series and parallel adaptors 
can be derived from Eqs. (17.9) and (17.11). For the S2 adaptor we have 


H q (z) = 


F 2q = 


m s2 (F s - 1) 

Di 

—C 2 + C 2 F p 


Flq = 


—Ci + C 3 F r — C 2 F s — F r F s 

D, 


Do 


C, F s - F p F s 
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(a) 



1 2 3 4 « 

(b) 

Figure 17.20 Analysis of wave digital filters: (a) Embedded adaptor, (b) block diagram. 


where 


D\ — 1 + C 2 F r — C 2 F S + C\F r F s D 2 — 1 + C\F p — C 2 F S + C 2 F p F s 
Ci = m sl - 1 C 2 = m s2 - 1 C 3 = m sl + m s2 - 1 

Similarly, for the P2 adaptor 

tj / \ m pt(l + F s ) Ci + C 2 F r — C 2 F s + F r F s 

H < {1) = D, = - D, - 

„ _ C 2 + C 2 F p — C\F S + F p F s 
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where 


D i — 1 — C 2 F r + C 2 F S + C\F r F s D 2 — 1 — C\F p + C 2 F S + C2F p F s 
Ci = m pl - 1 C 2 = m p2 - 1 C 3 = + m p2 - 1 

These relations apply to SI and PI adaptors except that m s2 = 1 and m p2 = 1. 

Now consider the filter of Fig. 17.20/; and assume that the adaptors of the main path are 
numbered consecutively from input to output. The overall transfer function of the filter is 


H(z) = 


Bin 

~Au 


Since the reflected and incident wave quantities at the output of adaptor q become the incident and 
reflected wave quantities at the input of adaptor q + 1, respectively, we can write 


H(z) = 


B 2 \ b 22 
A u B 2l 


b 2 „ 

B 2 (n-1) 


B 2 i B 22 B 2n 
An An A\ n 


Therefore 


H(z)=l[H q (z) (17.32) 

q=l 

For the connection of Fig. 17.20a, H q (z ) and F\ q depend on F s and F r , as was shown earlier. 
If N s (N y ) comprises a cascade of adaptors, F s (F r ) will depend on the input function of the second 
adaptor in the cascade, which will in turn depend on the input function of the third adaptor, and 
so on. Consequently, for the filter in Fig. 17.20/;, the input functions of branches N\, N 2 , ... must 
be evaluated first, starting with the last adaptor and proceeding to the branch input in each case. 
Subsequently, the main-path adaptors should be analyzed, starting with the output adaptor and 
proceeding to the filter input. With the frequency responses of the individual main-path adaptors 
known, the overall response of the filter can be evaluated by using Eq. (17.32). 

17.9 SCALING 

The signal-to-noise ratio in wave digital filters can be improved by applying signal scaling, as in 
other types of digital filters. This can be achieved by scaling the incident and reflected wave quan¬ 
tities at port 1 of the z'th adaptor by factors A; and 1/A, , respectively, as depicted in Fig. 17.21. The 
first multiplier scales down the inputs of adaptor multipliers in order to avoid overflow, whereas the 
second one ensures that the input functions at ports 1 and 2 of the adaptor remain unchanged after 
the application of signal scaling. Note that the two multipliers form a 2-port that is equivalent to an 
ideal transformer in the analog network with a turns ratio of A, as can be seen in Fig. 17.9c. 

If the top and bottom multiplier constants are not exactly the reciprocal of each other, then 
frequency-response errors similar to coefficient-quantization errors will occur. This problem can be 
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Figure 17.21 Application of signal scaling to wave digital filters. 


avoided in practice by choosing X to be a power of 2. This choice of constant has the additional 
advantage that both scaling multiplications become simple data shifts which are easy to implement. 
Unfortunately, however, with this choice of X the signal-to-noise ratio cannot be optimal. 

17.10 ELIMINATION OF LIMIT-CYCLE OSCILLATIONS 

In Sec. 14.9.3, it was shown that in certain second-order structures zero-input limit-cycle oscillations 
can be eliminated by carrying out the quantization of signals in terms of magnitude truncation. A 
similar approach is applicable for the class of wave digital filters, as was demonstrated by Fettweis 
and Meerkotter [22]. The details of this approach are as follows. 

Consider the wave digital filter of Fig. 17.22, where block B is a linear subnetwork containing 
adders, multipliers, and interconnections but no unit delays or delay-free loops. Further, assume that 
signal quantization is carried out by using quantizers Q k for k = 3, 4,..., N, as shown, and let the 
block enclosed by dashed lines be referred to as block B. The quantity 


p k (n) = G k al(n) 


where G k is the conductance assigned to the kth port, represents the power 3 stored in the A'th unit 
delay at instant nT. Since port conductances can be assigned on an arbitrary basis as long as pairs 
of interconnected ports are assigned the same conductances (see Sec. 17.3), G k for k = 3, 4, ..., N 
can be assumed to be positive without any loss of generality. Hence the total power stored in all the 


3 


Fettweis refers to this quantity as pseudopower to distinguish it from its analog counterpart which is actual power. 
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B 


Figure 17.22 Elimination of zero-input limit-cycle oscillations in wave digital filters, 
unit delays at instant nT can be obtained as 

N 

Po(n ) = ^2 G ka 2 k {n) 
k =3 

The increase in Pd(b) after one filter cycle is given by 

&PD(n) = PD(n + 1) - p D (n ) 

N 

= ^2 Gk [ a k( n + !) - fl *( n )] 

k= 3 

and since 

a k (n + 1) = b k {n) 

we have 

N 

A p D (n) = ^2G k \b\{n) - a 2 k (n)] 
k= 3 

The total power absorbed by block B at instant nT is given by 

2 N 

P N ( n ) = ^2 G k [a k (n) - b\(n)\ + ^ G k [aj(n) - b 2 k (n )] 
k= 1 k= 3 


(17.33) 


(17.34) 


(see Ref. [3]). Hence, Eqs. (17.33) and (17.34) give 
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2 

A p D (n) = - p N (n ) + ^G k [a 2 k (n) - b\(ri)\ 

k— 1 

and under zero-input conditions such that a\(ri) = ci 2 (n) = 0, we have 

A p D (ji) = -p N (n ) - G\b 2 (n) - G 2 b\{n) (17.35) 

If the reflected quantities at ports 3 to N are quantized such that 

\b k (n)\ < \b k (n)\ for k = 3, 4,..., IV (17.36) 

then from Eqs. (17.35) and (17.36), the power absorbed by block B can be expressed as 

2 N 

p N oo = Gk [ a i _ + X ! Gk l a ^ n ) - him] 

k= 1 ^=3 

N 

> J2 Gk - **(")] = pw(») ^ 17 - 37 ) 

Ar=l 

where Pn{h) is the power absorbed by block 5. Now if block />’ represents a wave digital filter 
derived from a passive network, we have [3] 

p N (n) > 0 (17.38) 

and from Eqs. (17.37) and (17.38), we conclude that 

p N {n) > 0 

Hence Eq. (17.35) yields 


A p D (n) < 0 

Under these circumstances, the total power stored in the unit delays cannot increase and, for the rea¬ 
sons stated immediately after Eq. (14.88), the wave digital filter cannot sustain zero-input limit-cycle 
oscillations. Therefore, wave digital filters obtained from passive networks support the elimination 
of zero-input limit cycles. 

Overflow oscillations can be eliminated as in other realizations that support the elimination of 
zero-input limit cycles, as described in Sec. 14.9.4 (see Ref. [36] of Chap. 14). 


17.11 RELATED SYNTHESIS METHODS 

An alternative but closely related methodology for the design of low-sensitivity digital filters has been 
developed by Vaidyanathan and Mitra and others [23, 24]. This methodology encompasses concepts 
that are analogous to those found in classical network synthesis (such as, passivity, positive real 
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functions, 2-port networks, and extraction of elements) and provides a framework for the realization 
to be carried out entirely in the z domain without recourse to LC prototype filters. The methodology 
can be used for the realization of a variety of types of filters, including wave ladder and lattice filters 
as well as low-sensitivity nonrecursive filters. 

Yet another class of low-sensitivity filters is the class of lossless-discrete-integrator (LDI) 
ladder filters, proposed by Bruton [25] and developed further by Bruton and Vaughan-Pope, and 
others [26-28]. As in wave digital filters, low sensitivity is achieved by emulating analog LC filters. 
In this approach, the problem of delay-free loops is avoided by replacing the bilinear transformation 
by the transformation 



In this way, the required digital filter is obtained directly from the analog filter without recourse 
to the wave characterization. The penalty paid is that the one-to-one correspondence between the 
imaginary axis of the s plane and the unit circle of the z plane is lost and, as a consequence, various 
techniques must be used to correct the distortion introduced in the amplitude response. 

17.12 A CASCADE SYNTHESIS BASED ON THE WAVE 
CHARACTERIZATION 

The wave characterization along with the concept of the generalized-immittance converter (GIC) 
[29] can be used to develop an alternative to the cascade realization of Sec. 8.2.5 [11, 30]. The details 
of this approach are as follows. 

17.12.1 Generalized-immittance Converters 

A GIC is a 2-port whose input admittance T, is related to the load admittance Y f by 

Y, = h(s)Y L 

where h(s) is the admittance conversion function of the device. Two specific types of GIC can be 
identified, namely, voltage- and current-conversion GICs. The current-conversion GIC (CGIC) is 
characterized by the terminal relations 


Yi = V 2 I\ = ~h{s)h (17.39) 

This is usually represented by the symbol of Fig. 17.23a. 

17.12.2 Analog G-CGIC Configuration 

By interconnecting three conductances and two CGICs, we can construct the G-CGIC configuration 
of Fig. 17.24a [31]. If each CGIC is assumed to have a conversion function h (s) = s, straightforward 
analysis yields 


V a _ IzqGq + k\G\S + k 2 G 2 s “ 
Vi - Go + G lS + G 2 s 2 
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h(s) : 1 h 





Figure 17.23 (a) Current-conversion generalized-immittance converter, ( b) digital realization. 


and if G r = b, and k r = a r /b r for r = 0, 1, 2, the network realizes the transfer function 


H(s) = 


ao + flii + ci2S 2 

b 0 + bis + b 2 s 2 


(17.40) 


By cascading a number of sections like the above any stable continuous-time transfer function can 
be realized. 


17.12.3 Digital G-CGIC Configuration 

Like an LC network, the G-CGIC network of Fig. 17.24 a can be readily simulated by digital elements. 
We need only develop a digital realization for the CGIC by using the procedure outlined in Sec. 17.4. 
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■*: 1 s: 1 



(b) 



(c) 


Figure 17.24 ( a ) Analog G-CGIC configuration, ( b ) identification of iV -ports, (c) digital realization. 

On assigning wave quantities and conductances to the CGIC ports as illustrated in Fig. 17.23a, 
and then using Eqs. (17.1), (17.4), and (17.39), we can show that 

fit = A 2 + (A x - A 2 )F(z) B 2 = A l + (Aj - A 2 )F(z) 


where 


F(z) 


G i - G 2 h(z) 
G\ + G 2 h(z) 


Hz) 



(17.41) 


z + 1 
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Hence with h(s) = s and G\ = 2 G 2 IT , Eq. (17.41) reduces to 

F(z) = z" 1 


Therefore, a digital realization for the CGIC can be obtained, as depicted in Fig. 17.23 b. 

The individual A-ports of the G-CGIC configuration can now be identified, as indicated in 
Fig. 17.24/?. On assigning the port conductances 


Gia = 


TG 0 
2 



Gia = G\ 


the general second-order digital section of Fig. 17.24c can be derived. An output proportional to V 0 
can be formed by using an adder at the input or output of any one of the CGICs, as in Fig. 17.24c, 
or at port 3 of the adaptor. This is permissible by virtue of Eq. (17.39). 

The transfer function of the derived structure can be obtained from Eqs. (17.1) and (17.4) as 


H d (z) 


17.12.4 Cascade Synthesis 

Almost invariably recursive filters are designed by using Butterworth, Chebyshev, Bessel-Thomson, 
or elliptic transfer functions which have zeros at the origin of the s plane, on the imaginary axis, or 
at infinity (see Chap. 10). Flence the continuous-time transfer function can be realized as a cascade 
connection of second-order sections characterized by transfer functions of the type 


B 0 _ Bt + A2 
At = A,- 


2V 0 

Vi 


= 2 H(s) 


_ 2 
S ~T 


z + 1 


H a (s) = 


N a (s) 

bo + b\s + s 2 


where N A (s) can take the form bo, s 2 , b\s, or ao + s 2 for a lowpass (LP), highpass (HP), bandpass 
(BP), or notch (N) section, respectively. On the other hand, delay equalizers are designed by using 
allpass (AP) sections, in which 


H a (s) = 


b 0 - bis + s 2 
bo + b\s + s 2 


(see Sec. 5.6.2). 

Evidently, the above transfer functions are special cases of the transfer function in Eq. (17.40), 
and, therefore, they can all be readily realized by using the digital structure of Fig. 17.24c. The 
resulting structures are shown in Fig. 17.25, where 


= fco-(2/r)j7 1 -(2/T) 2 
mi bo + (2/ T)b\ + {2/ T) 2 
bp + (2/ T)b\ — (2/ T) 2 
mi bo + (2/ T)b\ + (2/ T) 2 


(17.42) 

(17.43) 

(17.44) 


in each case. 
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Figure 17.25 Universal second-order CGIC sections: (a) Lowpass, (b) highpass. 


With a set of universal sections available, any Butterworth, Chebyshev, Bessel-Thomson, or 
elliptic digital filter satisfying prescribed specifications can be designed by using the following 
procedure: 

1. Using the specifications, derive the appropriate normalized lowpass transfer function according 
to steps 1 to 3 in Sec. 12.4. 

2. Apply the transformation in Eq. (12.1). 

3. Select suitable sections from Fig. 17.25. 

4. Calculate the multiplier constants using Eqs. (17.42)-( 17.44). 

5. Connect the various sections in cascade. 
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-1 m \ 



Example 17.4 


A Butterworth lowpass filter is characterized by 


3 

H(s) = l 


i =i 


b Qj 

boj + bijs + s 2 


where coefficients bjj are given in Table 17.2. Design a corresponding digital filter by using 
the CGIC cascade synthesis. The sampling frequency is 10 4 rad/s. 
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■ Solution 

The filter can be designed by cascading three LP sections of the type shown in Fig. 17.25 a. 
The values of the multiplier constants can be readily evaluated as in columns 4 and 5 of 
Table 17.2. ■ 


Table 17.2 Lowpass-filter parameters (Example 17.4) 


j _ K _ hi «i j _ m V 

1 1.069676E + 6 5.353680E + 2 -8.342350E - 1 5.701500E - 1 

2 1.069676E + 6 1.462653E + 3 -8.650900E - 1 2.778910E - 1 

3 1.069676E + 6 1.998021E + 3 -8.781810E - 1 1.538890E - 1 


17.12.5 Signal Scaling 

Assuming a fixed-point implementation, the CGIC sections of Fig. 17.25 can be scaled by using 
Jackson’s technique (see Sec. 14.6.2). For this purpose each of the five sections can be represented 
by the signal flow graph of Fig. 17.26a, where 


H a (z) = 


N a (z) 

D(z ) 


H b (z) = 


N b (z) 

D(z ) 


and 


H d (z) = 


N d (z) 

D(z ) 
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(b) 

Figure 17.26 Universal CGIC sections: (a) Scaling model, ( b ) noise model. 


are the transfer functions between section input and nodes A, B, and Z), respectively. The above 
polynomials are given in Table 17.3. The optimum value of X, for L x scaling, is given by 

1 

1 “ max [\\H A (e^ T )\U ||ZW" 7 ’)lloo, l|/W wr )lloo] 


17.12.6 Output Noise 

For the purpose of noise analysis, the five CGIC sections can be represented by the model of 
Fig. 17.26 b, where e(n) is the noise component generated by one multiplier and 


H e (z) = 


(z + 1)(Z - 1) 
D(z) 


H f (z) = 


(1 + m i )(z + l) 2 
D(z) 


are the transfer functions between nodes E and F and section output. The dotted line in Fig. 17.26/r 
applies to the N section only. 
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Table 17.3 Polynomials in CGIC sections 


Type 

N a (s) 

N D (z) 

N A (Z) 

AWz) 

LP 

bo 

(1 + m\)(z + l) 2 

(z - m 2 )(z + 1) 

(1 + ill i )(z + 1) 

HP 

s 2 

(1 + m2)(z - l) 2 

(z + imXz - 1) 

—(1 + m 2 )(z - 1) 

BP 

b\s 

Oil + /J72)(l — z 2 ) 

— (z 2 — 2m 2 z + 1) 

—(z 2 + 2iiiiz + 1) 

N 

a 0 + s 2 

fc 0 (l + mi)(z + l) 2 
+(1 + m 2 )(z - l) 2 

ko(z - m 2 )(z + 1) 

—(1 + m 2 )(z — 1) 

Ml + mi)(z + 1) 
+(z + miXz - 1) 

AP 

bo — bis + s 2 

2[(1 + mi + m 2 )z 2 
+(mi - m 2 )z + 1] 

2(z 2 — 2 m 2 z + 1) 

2(z 2 + 2iiiiz + lj 

D(z) 

= Z 2 + (m i - 

m 2 )z + (1 + mi + in 2 ) 



On using the approach of Sec. 14.5 the power spectral density (PSD) of the output noise can 
be deduced as 


So(e ja>T ) = [\H D (e jo,T )\ 2 + 2\H F (e jo,T )\ 2 + \H F (e jaT )\ 2 ]S e (e jo,T ) 
a 2 

where S e (e JwT ) = and H F (e ja>T ) = 0 

in all sections except for the N section in which 

H F (e ja>T ) ± 0 

A useful property of the CGIC sections can be identified at this point. H F (z) is a bandpass 
transfer function in each of the five sections. As a consequence, noise generated by multipliers m i 
and nii will be attenuated at low as well as high frequencies, becoming zero at w = 0 as well 
as at co = co s /2. By contrast, in the conventional canonic sections noise due to the multipliers is 
subjected to the same transfer function as the signal; e.g., in a lowpass section, the quantization noise 
is subjected to a lowpass transfer function. Because of this property, the CGIC synthesis tends to yield 
lowpass, highpass, and bandstop filters and also equalizers with improved in-band signal-to-noise 
ratio [11, 30]. In addition, like wave structures derived from passive networks, CGIC structures can 
be designed to be free of zero-input and overflow limit-cycle oscillations, as was demonstrated by 
Eswaran and Ganapathy [32]. 

17.13 CHOICE OF STRUCTURE 

This chapter, like Chap. 8 , has demonstrated that many distinct structures are possible for a given 
set of filter specifications. Hence one of the initial tasks of the filter designer is to choose a structure. 
The principal factors in this task are the sensitivity of the structure to coefficient quantization, the 
level of output roundoff noise, and the computational efficiency of the structure. As may be expected, 
these factors tend to depend to a large extent on the desired specifications; on the type of filter, i.e., 
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lowpass, bandpass, etc.; on the type of approximation used, i.e., Butterworth, elliptic, etc.; on the type 
of arithmetic, i.e., fixed-point or floating-point; on the number system used, i.e., two’s-complement, 
signed-magnitude, etc.; on the scaling norm used, i.e., L 2 or and, in cascade structures, on the 
pairing of zeros and poles into second-order transfer functions, on the ordering of sections, and so on. 
Consequently, categorical statements about one or the other type of structure are difficult to make. 
Nevertheless, certain tendencies have been noted by researchers in the field, as follows: 

1. High-order direct structures are very sensitive to coefficient quantization and also generate a 
high level of roundoff noise [33-35]. 

2. Cascade, parallel, and wave structures tend to have similar sensitivities for fixed-point arithmetic 
[30], [33-35], 

3. Parallel structures tend to generate a lower level of roundoff noise than cascade structures 
[34, 38, 39]. However, they tend to be more sensitive to coefficient quantization at stopband 
frequencies because the zeros can wander off the unit circle. 

4. For filters with zeros on the unit circle of the z plane, cascade canonic structures involve the 
lowest number of arithmetic operations. 

5. The direct second-order structures described in Sec. 14.4 lead to low sensitivity and are, in 
addition, suitable for the application of error-spectrum shaping which can reduce the level of 
output roundoff noise quite significantly. However, signals must be scaled before and after each 
multiplication (see Ref. [9] of Chap. 14). 

6. State-space structures can be designed to have minimum roundoff noise but require a large 
number of multiplications (see Refs. [15, 17] of Chap. 14). 

7. Wave structures are significantly less sensitive than cascade structures for floating-point arith¬ 
metic [36, 37]. Similar results are expected for fixed-point arithmetic provided that scaling is 
applied before and after each multiplication. However, if the signal scaling constants are not 
powers of two, mismatch can arise at the inputs of adaptors, which can increase the sensitivity. 

8. Lattice wave structures tend to be more sensitive to coefficient quantization at stopband frequen¬ 
cies than ladder wave structures. 

9. CGIC cascade structures tend to yield improved in-band signal-to-noise ratio [11, 30]. 

10. State-space, wave, and CGIC structures can be designed to be free of limit-cycle oscillations. 

It should be mentioned that the choice of structure involves many other issues besides the 
above, e.g., the suitability of the structure to the application at hand, the amenability of the structure 
to VLSI implementation (see Sec. 8.3), and the cost of the hardware. Also, in applications where 
very high sampling rates are employed, the degree of parallelism inherent in the various structures 
should be considered. In canonic structures, all multiplications can be performed simultaneously 
and, as a consequence, the time taken to complete the processing for one filter cycle can be nearly 
as short as the time taken to perform one multiplication. In wave structures, multiplications must be 
performed in sequence according to a certain hierarchy because of topological constraints, and hence 
the minimum time required to do the processing for one filter cycle can be much longer [30, 33]. 
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PROBLEMS 

17.1. Figure PI7.1 depicts an equally terminated LC filter. 

(a) Obtain a signal flow graph for the filter by applying Kirchhoff’s voltage and current laws. 



(b) Show that the application of the bilinear transformation to the signal flow graph of part (a) leads to 
at least one delay-free loop. 
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17.2. Figure P17.2 represents an independent current source with an internal impedance Z(j) = s x R x . Obtain 
digital realizations for X = —1,0, and 1 if R = (2 /T) X R X . 


I 



17.3. Analyze the series adaptors of Fig. 17.6a and b. 

17.4. Analyze the parallel adaptors of Fig. 17.7a and b. 

17.5. Show that a 2-port series adaptor and a 2-port parallel adaptor are interrelated by the equivalence of 
Fig. P17.5. 



Figure P17.5 



17.6. (a) Analyze the 2-port parallel adaptor of Fig. 17. 8b. 

(b) Obtain an alternative 1-multiplier 2-port parallel adaptor. 

17.7. Show that a 2-port parallel adaptor is equivalent to the realization of a transformer with a turns ratio 
k = 1. 

17.8. The 2-port of Fig. P17.8, where Vi = — RI 2 and V 2 = /?/i, represents a gyrator circuit. Obtain a 
corresponding digital realization. 


h h 



17.9. A 2-port in which the input impedance Z, is related to the load impedance Zi by Z,- = —kZi is said to 
be a negative-impedance converter (NIC). The parameter k is referred to as the impedance-conversion 
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factor of the device. Two types of NICs can be identified, namely, voltage-conversion NICs, in which 

Vi = -kV 2 h = ~h 
and current-conversion NICs, in which 


Vi = V 2 h = kl 2 

Derive digital realizations for each case if port resistances R i and R 2 are assigned to the input and output 
ports, respectively. 

17.10. (a) Obtain a digital realization of the parallel resonant circuit of Fig. P17.10a using a parallel adaptor. 

(b) Show that the resonant circuit of Fig. P17.10a can be realized by a unit element terminated by an 
inductance L 0 as depicted in Fig. PI7.10£>. Obtain expressions for R 0 and L 0 . 

(c) Obtain a digital realization of the resonant circuit in part (b). 



(a) 



17.11. Obtain a digital realization for the transfer function 


H(s) = 


24s 4 - 24s 3 + 20s 2 - 2s + 1 
24s 4 + 24s 3 + 20s 2 + 2s + 1 


17.12. Derive the wave characterization of the lattice network given in Fig. 17.14a. 

17.13. A fifth-order Chebyshev lowpass filter with passband edge a> p = 1 rad/s and passband ripple 1 dB is 
characterized by the transfer function 

0.1228 

“ (s + 0.2895)(s 2 + 0.4684s + 0.4293)(s 2 + 0.1789s + 0.9883) 

Assuming a sampling frequency of 8 rad/s, obtain a lattice realization for the filter. 

17.14. An application calls for a highpass digital filter that would satisfy the following specifications: 

A p = 1.0 dB A a = 45.0 dB = 3.5 rad/s Q a = 1.5 rad/s 


The sampling frequency a> s is to be 10 rad/s. 
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(a) Obtain the required transfer function using a Butterworth approximation. 

(b) Realize the transfer function obtained in part (a) using a wave lattice structure. 

17.15. Repeat parts (a) and (b) of Prob. 17.14 using an elliptic approximation. 

17.16. Figure P17.16 shows an elliptic lowpass filter. Obtain a corresponding wave structure, assuming a 
sampling frequency u> s = 10 rad/s. 



Figure P17.16 h = L 3 = 3.0316 H L 2 = 0.21286 H C 2 = 1.4396 F R= 1 S2 
17.17. Figure P17.17 shows an elliptic highpass filter satisfying the following specifications: 

A p = 0.5 dB A a = 31.2 dB cu p = 1 /V0.5 rad/s o> a = Vo.5 rad/s 

(a) Obtain a corresponding wave digital filter, assuming that a> s — 10 rad/s. 

(b) Determine the resulting passband and stopband edges. 



■o 


-o- 


Figure P17.17 L l = L 3 = 0.48948 H L 2 = 3.4132 H C 2 — 0.75489 F R = HI 

17.18. An analog bandpass filter can be obtained by applying the lowpass-to-bandpass transformation 



to the lowpass filter of Fig. P17.16. Derive a corresponding wave digital filter if a> s = 250 rad/s. 

17.19. Design a lowpass digital filter that would satisfy the specifications 

A p = 1.0 dB A a > 60.0 dB S2 p w 100 rad/s f2 a ~ 200 rad/s 

assuming a sampling frequency of 1000 rad/s. Use an elliptic approximation and a wave ladder realization. 
(Hint: Use the tables in Ref. [14] or one of the available filter-design software packages.) 

17.20. By applying the impedance transformation Z(s) —> Z(s)/s to the filter of Fig. P17.16, derive a corre¬ 
sponding FDNR wave digital filter. 

17.21. Repeat Prob. 17.20 using the highpass filter of Fig. P17.17 as a prototype. 

























826 DIGITAL SIGNAL PROCESSING 


17.22. The multiplier constants for the filter of Fig. 17.17c are given in Table P17.22. Compute the amplitude 
response of the filter if a> s = 10 rad/s. 

Table P17.22 


Adaptor Multiplier constants 


1 m p i = 1.341381F - 1 

m p 2 — 1.0 

2 m s i = 9.615504£ - 2 

m s 2 = 1.0 

3 m p i = 1.720167F - 1 

m p2 = 2.399664F - 1 

4 m p i = 2.436145F - 1 

m p 2 = 1.0 


17.23. Compute the amplitude response of the digital filter depicted in Fig. P17.23, assuming that a> s = 
10 rad/s. The values of the multiplier constants are given in Table P17.23. 



Figure P17.23 
Table P17.23 


Adaptor Multiplier constants 


1 m s \ = 5.846557F - 1 
m s 2 = 1.0 

2 m p i = 4.307685F - 1 

m p 2 = 1.0 

3 m s i = 6.021498F - 1 

m s 2 = 8.172611£ - 1 

4 m s i = 1.466151F — 2 

m s 2 = 1.0 
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17.24. Obtain a digital realization for a general 2-port represented by Eqs. (17.14a) and (17.14b). 

17.25. (a) Obtain a digital realization for the 2-port of Fig. P17.25a, assuming that Ri = R 2 + L and a> s = jt 
rad/s. 

(b) Repeat part (a) for the 2-port of Fig. P17.25 b if Gi = G 2 + C and u> s = n rad/s. 


L 

■nmr^ 


*1 


r 2 


o- 


-o 


G, C G 2 


o- 


-o 


o 


-o 


(a) 

Figure P17.25 


( b ) 


17.26. (a) Show that the analog filter of Fig. P17.26, where R = 1 C = 1 F, and L = 2 H, represents a 
3rd-order Butterworth filter. 

(. b ) Derive a corresponding digital filter using the realizations of the inductor and capacitor obtained in 
Prob. 17.25. 


-VA—' 

>- r 0W' -- 

— 

— 


= c ~ 




Figure P17.26 


17.27. Analyze the configuration of Fig. 17.24«. 

17.28. (a) Derive the lowpass section of Fig. 17.25a. 
(. b ) Derive the highpass section of Fig. 17.25&. 

17.29. An analog highpass filter is characterized by 


ms)=n 


s =1 


boi + bus + s 2 


where b ol = bo 2 = &03 = 31.15762 b n = 10.78340 

b i2 = 7.8940 b n = 2.889405 

Obtain a corresponding digital filter by using the CGIC synthesis, assuming that co s = 10 rad/s. 

17.30. Design a CGIC digital lowpass filter satisfying the following specifications: 

A p — 0.5 dB A a = 65 dB Q p = 200 rad/s 
O a = 300 rad/s co s = 1000 rad/s 


Use an elliptic approximation. 
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CHAPTER 

18 


DIGITAL SIGNAL 
PROCESSING 
APPLICATIONS 


18.1 INTRODUCTION 

In the past several chapters, some sophisticated design methods have been described in detail. In 
this chapter, we consider a number of extensions of these methods and some of their numerous 
applications to digital signal processing. 

The chapter begins with the underlying principles involved when the sampling frequency is 
changed from one value to another, and devices that can be used for the conversion, known as 
decimators and interpolators, are described [1], The application of decimators and interpolators in 
the design of filler banks [2-4] is then considered. These subsystems find widespread applications 
in communications systems, spectrum analyzers, and speech synthesis. The principles involved are 
examined and a specific type of filter bank, the so-called quadrature-mirror-image filter bank, is 
examined in some detail. Another useful device for communications applications is the Hilbert 
transformer. Its theoretical basis, design principles, and applications to the sampling of bandpassed 
signals and to single-sideband modulation are described in Sec. 18.4. 

Another topic that is receiving considerable attention these days is the design and applications 
of adaptive filters. These are filters that have an adaptation mechanism which allows them to change 
their characteristics with time in order to satisfy some performance requirement. The topic is a field in 
its own right, and several textbooks have been written on the theory and design of these filters [5-8]. 
In Sec. 18.5, we examine some of the fundamentals involved and consider some of the algorithms 
that are being used as adaptation algorithms. 
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In many applications, the signal to be processed is a function of two discrete variables. Signals 
of this type can be processed by two-dimensional (2-D) digital filters. The methods involved are 
usually extensions of their one-dimensional (1-D) counterparts, but once in a while there are marked 
differences. As in the case of adaptive filters, the topic of 2-D digital filters is emerging as an important 
field of study, and some textbooks have already been written on the subject [9-11 ]. For the sake of 
completeness, we conclude this chapter by examining some of the basic principles involved in the 
analysis and design of these filters. 


18.2 SAMPLING-FREQUENCY CONVERSION 

For various technical reasons, it may be preferable to store or record a discrete-time signal using one 
sampling frequency but process or transmit it using another sampling frequency. The conversion of the 
sampling frequency from one value to another can be accomplished in an indirect way by converting 
a discrete-time signal back to a continuous-time using a D/A converter then sampling the latter at a 
different rate using an A/D converter. However, each such conversion introduces quantization noise 
and sin co/co distortion, as well as other problems. An alternative and more satisfactory approach 
is to carry out the conversion in the discrete-time domain using a class of digital filters known as 
decimators and interpolators. 

Decimators can be used to reduce the sampling frequency, whereas interpolators can be used to 
increase it. This section deals with the underlying principles involved in connection with sampling- 
frequency conversion in the discrete-time domain and highlights some design aspects concerning 
decimators and interpolators. 


18.2.1 Decimators 

Let us first examine the situation where the sampling frequency of a discrete-time signal x(nT ) is to 
be reduced. 

If x(nT) is deemed to have been obtained by sampling a continuous-time signal x(t) using 
a sampling frequency op , then the frequency spectrum of x(nT) can be readily obtained from 
Eq. (6.45a) as 1 


| uu 

X(e jwT )=- J2 X c [j(co-nco s )] 

n=—oo 

where 


(18.1) 


X c (joj) — Tx(t) and X(z) — Zx(nT) 

Let the new sampling frequency be op — a) s /M where M is an integer greater than unity. Since the 
sampling period is increased from T to T = MT, a signal x^inT') is obtained which is related to 


l The notation has been changed somewhat for the sake of convenience. 
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x(nT) by the equation 


Xd(nT') = x(nT') — x(nMT) 

That is, Xd(nT') is obtained by retaining only samples ... , —2 M, — M, 0, M, 2M, ... of discrete¬ 
time signal x(nT ) as shown in Fig. 18.1 for the case where M — 3. This process has been referred 
to in the past as downsampling, sampling-frequency compression, or discrete-time sampling [1], A 
device that can perform this operation is said to be a downsampler, sampling-frequency compressor, 
or simply compressor and is often represented by the block diagram depicted in Fig. 18.2a. 




nT 


(b) 



Figure 18.1 The process of downsampling. 
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x(nT) O- 


M 


x d (nT') 


(a) 



( b ) 


Figure 18.2 (a) Downsampler, (b) decimator. 


By analogy with Eq. (18.1), the spectrum of signal x d (nT ') can be readily expressed as 

1 OO 

X d (e imr ) = — Y X c [j(co-nco ' s )] 

n=—oo 
. oo 

= — Y 

MT X-* 

n=—o o 

i.e., the spectrum of x d (nT r ) can be regarded as an infinite sum of shifted copies of the spectrum of 
x(t ) divided by MT, where each copy is shifted by a multiple of co s /M. Alternatively, Eq. (18.2) can 
be expressed as 


■ 

I co — n — 
1 \ M 


(18.2) 


X d {e j0>r ) 


1 

~MT 


oo M— 1 

EE ! - \i 


n=—o o m =0 


( w»\l 

io — na, — m — 

V MJ\ 


since X,i(e J '" T ) can be considered to be periodic with period co s , and hence 


X d (e j0)T ') = 


1 

M 


M -1 

E 

m =0 



j 


( \ 

(o — na> s —m — > 

V M/JJ 


1 

M 


M -1 


X(e^ al ~ mWs ^ M)T ) 

m= 0 


(18.3) 


According to this representation, the spectrum of x d (nT) may be deemed to be the sum of M copies 
of the spectrum of x{nT) divided by M, where each copy is shifted by a multiple of u> s /M. 

The above conversion process is illustrated in Fig. 18.3 for the case where M = 3 and X c (ja>) 
is real. As can be seen, if X c (jco ) = 0 for \a>\ > w s /2M, then the copies of the spectrum of x(nT ) 
produced by downsampling do not overlap and, as a consequence, x(t) can be recovered by using 
an ideal lowpass filter with cutoff frequency co s /2M. If the aforementioned requirement is violated, 
then aliasing will be introduced, as detailed in Sec. 6.7. To avoid this possibility, a bandlimiting filter 
with cutoff frequency a> c = a> s /2M is usually used at the input of the downsampler, as depicted in 
Fig. 18.2Z?. The configuration obtained is said to be a decimator. 
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(a) 



(b ) 



Figure 18.3 Operation of downsampler. 


18.2.2 Interpolators 

The preceding section has shown that sampling-frequency reduction can be achieved by applying 
downsampling which is analogous to the sampling of a continuous-time signal. We now show that 
a sampling-frequency increase can be achieved through a process which is analogous to converting 
a discrete-time signal into a continuous-time signal. 

A sampling-frequency increase from co s to Lco s , where L is an integer, can be achieved by using 
a device known as an upsampler, sampling-frequency expander, or simply expander in conjunction 
with a lowpass filter [1], An upsampler is usually represented by the block diagram depicted in 
Fig. 18.4a, and its response to an excitation xinT), designated as x u {nT), can be expressed as 


x u (nT') = 


x(nT/L) for n = 0, ±L, ±2L,... 

0 otherwise 


(18.4) 
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x(nT ) O 


L 


(a) 


o xJfiT') 


x u (nT) 



-o Xj(nT ) 


(b) 

Figure 18.4 (a) Upsampler, (b) interpolator. 


where T = T/L. This process is illustrated in Fig. 18.5 for the case where L — 3. Equation (18.4) 
can be written as 


OO 

Xu(nT') = E x(kT)S(nT - kLT) 

k =—oo 

and by applying the z transform, we obtain 


OO 

X u (e ja>T ')= Y, 

n =—oo 


oo 

Y x(kT)S(nT - kLT) 

_k ——oo 


— jojnT' 

e J 


oo oo 

= Y E x(kT)[S(nT - kLT)e- ja>nT/L ] 

k =—oo n =—oo 


oo 

= Y x(kT)e~ jcokT = X(e J,oT ) 

k =—oo 


(18.5) 


In effect, the frequency spectrums of x u (nT') and x(nT ) are identical , as illustrated in Fig. 18.6a 
and b for the case where L — 3. Since T = T/L, or of = Lop, there are L images of the signal 
in the baseband —w'J 2 < o> < of/2, that is, upsampling will simply change the location of the 
sampling frequency as shown. 

A discrete-time version of x(nT), sampled at the increased rate of of = Lco s , can now be 
generated by filtering signal x u (nT') using an ideal lowpass digital filter with a frequency response 


H(e lwl ") = 


L for 0 < \co\ < co , 

0 otherwise 


(18.6a) 















DIGITAL SIGNAL PROCESSING APPLICATIONS 835 





Figure 18.5 The process of upsampling. 


where u> c = co' s /2L , as illustrated in Fig. 18.4/?. This filter will reject unnecessary images and yield 
a discrete-time signal Xj(nT') = x(nT'), as illustrated in Fig. 18.6c and d. The configuration of 
Fig. 18.4/? is said to be an interpolator. 

The output of the lowpass filter in Fig. 18.4 b can be shown to be an interpolated version of 
x(nT) by finding the time-domain response of the ideal lowpass filter. We can write. 


Xi(z) = H(z)X„(z) 


( 18 . 6 b) 
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L 



y 




- 1 - 
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< 0 Wj coj 

2 L 2 L 2 


(c) 



(d) 


Figure 18.6 Operation of upsampler and interpolator. 
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where H(z) is the transfer function of the lowpass filter and since T — LT'. From Eq. (18.5), we 
have 


X u (z) = Zx u (nT') 

OO 

= Y x(kT)e~ ja>kLI " 


k=—o o 


e J(ol =z 


= x(kT)z 


-kL 


k=—o o 


(18.6c) 


and hence Eq. (18.6b) yields 


Xi {nT') = Z-\H{z)X u {z)} 


= Z~ l 


OO 

H(z) Y. x(kT)z~ kL 

k ——oo 


OO 

= Y x{kT)Z- l [H{z)z~ kL ] 

k=—o o 


(18.7) 


Now a digital filter with a frequency response H{e ■ , “ T ) as defined in Eq. (18.6a) has an impulse 
response 


h(nT') 


L , L co'nT' 

— sin co c nT ——sin —- 

TUT TUT 2 L 

sinjrn/2L 


ttti / 2L 


(see Example 9.1) and from Eq. (18.7) and the complex-convolution theorem (Theorem 3.10), 
Xj(nT') can be expressed as 


Therefore, 


OO 

Xi(nT')= Y x{kT)h[{n - kL)T'] 

k ——oo 


oo 

= y x(kT ^ 

k=—o o 


sin[7r(« — kL)/L\ 
7r(n — kL)/L 


Xi(nT') 


xiriT) 

0 


if k — n 
otherwise 


(18.8) 
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since 


sin[jr(« — kL)/L] I 1 if k = n 

jt(n—kL)/L lo otherwise 

The above analysis is analogous to the use of a lowpass filter to recover a continuous-time 
signal from an impulse-modulated signal as discussed in Sec. 6.6, that is, the relation in Eq. (18.8) 
is analogous to the interpolation formula in Eq. (6.51). 


Example 18.1 


Show that the use of a digital filter characterized by the impulse response 


h(nT') 


1 — \n\/L for | n\ < L 

0 otherwise 


(18.9) 


in the scheme of Fig. 18.4b will result in a system that can perform linear interpolation. 


■ Solution 

The response of the filter at nT' to an excitation x u (nT') is given by the convolution 
summation as 


x i(n ) = x u (k)h(n — k ) 
k=—oo 


where period T' is dropped for the sake of brevity. The response at (in L + X)T', where 
X is an integer in the range ()</.< L, is given by 


Xj(mL + X) = x u (k)h(mL + X — k) 

k=—o o 

= ■ ■ ■ + x u (mL — l)b(l + A) + x u (mL)h(X) 

+x u (mL + 1 )h(X - 1)4- 

+x u [(m + 1)L — \]h[X — (L — 1)] 

+x u [(m + 1 )L]h(X - L) 

-\~x u [{m + 1)L + 1 ]h[X — (L + 1)] + ■ ■ ■ (18.10) 
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From Eq. (18.4), x u {ri) = 0 if n is not a multiple of L: therefore, for 0 < /, < L, 
Eqs. (18.9) and (18.10) yield 

Xi(mL + X) — x u (mL)h(X) + x u [(m + 1 )L]h(X — L) 

= x u (mL) + ^ x u [(m + 1)L] 

which is the linear interpolation between samples mL and (m + 1)L. 


18.2.3 Sampling-Frequency Conversion 
by a Noninteger Factor 

Through the use of an interpolator, the sampling frequency can be increased from co s to co' s = Lco s . 
On the other hand, through the use of a decimator, the sampling frequency can be decreased from co' s 
to &>" = (o'JM. By cascading an interpolator and a decimator, as depicted in Fig. 18.7, a sampling 
frequency u >" = L(a s /M can be obtained, where L/M is a ratio of integers. By this means, arbitrary 
conversion factors can be achieved. In Fig. 18.7, the interpolator necessitates a lowpass filter with 
a cutoff frequency a>' s /2L, while in the decimator a lowpass filter with a cutoff frequency co’ s /2M 
is needed. One of the two filters, namely, the one with the higher cutoff frequency, is obviously 
redundant and can be eliminated. 

18.2.4 Design Considerations 

The design of interpolators and decimators is straightforward, and perhaps the most complicated 
part of the design involves the design of the required filters. Depending on the system requirements, 
a recursive or nonrecursive filter may be more appropriate, and any one of the methods described 
in Chaps. 9, 12, 15, and 16 can be used. Furthermore, a large variety of filter structures can be 
employed. A comparison between recursive and nonrecursive designs can be found in Sec. 11.8. The 
merits and demerits of the various types of structures can be found in Sec. 17.13. 

18.3 QUADRATURE-MIRROR-IMAGE FILTER BANKS 

Filter banks find applications in many areas of science and engineering and are used for time-division 
to frequency-division multiplex translation, subband speech coding, bandwidth compression, and 
many other types of signal processing [1, 2, 4]. In these systems, a given signal is decomposed 



Figure 18.7 Sampling-frequency conversion by noninteger factor. 
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into consecutive subbands that are processed independently. The subbands obtained are then used to 
synthesize a processed version of the signal. 

The motivation behind this roundabout way of processing a signal is usually to achieve some 
economical advantage, e.g., increased utilization of equipment or improved signal-to-noise ratio, but 
on occasion a filter bank is used to carry out some type of processing that cannot be carried out by 
any other means. Time-division to frequency-division multiplex translation is used quite extensively 
in communications systems in order to achieve increased channel capacity [12]. In subband speech 
coding, the signal is decomposed into several bands that are coded individually, taking advantage of 
certain perceptive properties of the human ear. In this way, improved signal quality can be achieved 
without increasing the bit rate [13]. 

In its most general form, a filter bank consists of a decomposition or analysis section and 
a reconstruction or synthesis section, as depicted in Fig. 18.8. Depending on the application, (1) 
the spectrums of xo(nT), x\(nT), ... , xk(u7') should not overlap, may overlap somewhat, or can 
overlap extensively; (2) the processed signal y(nT) must be a faithful reproduction of x(nT) or it may 
be a transformed version that bears little resemblance; and (3) the subband widths may be uniform, 
irregular, or fixed by some logarithmic relation. 

In this section, we consider a specific type of filter bank, the so-called quadrature-mirror-image 
filter (QMF) bank. 


18.3.1 Operation 

A 2-band QMF bank is illustrated in Fig. 18.9. The analysis section of the bank consists of a lowpass 
and a highpass filter which decompose the input signal x(nT) into two components xo(nT) and 


x{nT ) o- 


Analysis 
filter bank 


(a) 


o x 0 (nT) 
-o Xi(nT) 


O XgfiiT) 


x 0 (nT) o- 
Xi(nT ) o- 


x K {nT ) o- 


Synthesis 
filter bank 


-o 


y(nT) = x(nT) 


( b ) 


Figure 18.8 Filter bank: (a) Analysis section, (b) synthesis section. 
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x 0 (nT) x od (nT') x odu (nT") 



*1 (nT) x u (nT') x Uu (nT") 


Figure 18.9 2-band QMF bank. 


xi(nT). Ideally, the lowpass and highpass filters should have the frequency responses 


and 


H 0 (e^ T ) = 


for 0 < |tu| < 
otherwise 


(18.11) 


H x (e^ T ) 


for a > s /4 < |<w| < u> s /2 
otherwise 


(18.12) 


respectively. The operation of the filter bank is illustrated in Fig. 18.10 and 18.11. Downsampling by 
a factor M = 2 will produce shifted copies of the lowpassed and highpassed spectrums, as depicted 
in Fig. 18.10g and h and upsampling by a factor L = 2 will change the location of the sampling 
frequency, as shown in Fig. 18.1 In and b (see Sec. 18.2.2); that is, one image of each of the lowpassed 
and highpassed spectrums will be introduced in the baseband, as in Fig. 18.11a and b by analogy 
with Fig. 18.3. At the output, the synthesis lowpass and highpass filters, which should in principle 
be identical to the corresponding analysis filters, will regenerate Xo(nT) and x\(nT), respectively, as 
shown in Fig. 18.1 le and /. Hence the output of the adder will be the required signal, as depicted in 
Fig. 18.11*. 

In practical filters, the passband gain is not unity, the stopband loss is not infinite, and transitions 
between passbands and stopbands are gradual. Hence amplitude and phase distortion as well as 
aliasing will be introduced, as can be seen in Fig. 18.12. While the effects of these imperfections 
can be reduced by designing filters of better quality, these problems can largely be eliminated in a 
much simpler way by using lowpass and highpass filters whose frequency responses have certain 
symmetry properties. This possibility will now be examined. 
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Figure 18.10 Operation of analysis section of 2-band QMF bank. 
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Figure 18.11 Operation of synthesis section of 2-band QMF bank. 
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0 ) 

Figure 18.12 Effects of filter imperfections in 2-band QMF bank. 


18.3.2 Elimination of Aliasing Errors 

Let T — 2T and T" — T' /2 = T. From Eq. (18.3), the frequency spectrum at the output of the top 
down-sampler in Fig. 18.9 can be expressed as 


X od (e jaT ') = l 2 [X(e ja,r/2 )H 0 {e ja,T ' /2 ) + X(e KwI "/ 2 - x) )H 0 (e j(a,T ' /2 -*))] 


(18.13) 
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On the other hand, the frequency spectrum at the output of the top upsampler is given by Eq. (18.5) 
as 


Xodu(e ja,T ") = X 0du (e ia,T '' 2 ) = X 0d (,e j<or ) 


and from Fig. 18.9 


Y 0 (e jo,T ") = X 0iu (e ja)T ")F 0 (e jolT ") 


(18.14) 


(18.15) 


Now Eqs. (18.13)—(18.15) give 


Y 0 (e j<oT ”) = \[X(e ja,1 "/ 2 )H 0 (e Ja>T ' /2 ) 

+X(e Kwr/2 - n) )H 0 (e KaT ' /2 - x) )]F 0 (e jaT '') 

and on eliminating T' and T", we have 

Y 0 (e io)T ) = \[X(e ja,T )H 0 (e jaT ) + X(e^ <oT - Jt ' , )H 0 (e j ^ T - n) )]F 0 (e jloT ) 


Similarly, 

F 1 (e> 7 ’) = \\X(e jwT )H t (e ]a>T ) + X(e^ roT - n) )H l (e i ^ T - 7,) )]F l (e j<oT ) 

and, therefore. 


Y(e JcoT ) = Y 0 (e jloT ) + Y x (e iloT ) 

= \[Ho(e i<oT )F Q (e jcoT ) + H l (e jloT )F l (e ja,T )]X(e jo,T ) 

+ {[H 0 (eJ <mT - R) )F 0 (eJ a ’ T ) 

+H 1 (e j{alT - 7T) )F l (e ja>T )]X(e j(0,T - ,I) ) (18.16) 

The first term in the above relation represents the required signal, whereas the second term 
represents spurious components due to aliasing. If the filters are designed such that 

H 0 (e j(a,T - Jt) )F 0 (e jalT ) + H 1 (e i( - aT - n) )F 1 (e ja>T ) = 0 (18.17) 

then the aliasing produced by the lowpass filters will be canceled exactly by the aliasing produced 
by the highpass filters even if the quality of these filters is not particularly good. This relation can be 
satisfied by designing the analysis and synthesis filters such that 

F 0 (e jo,T ) = 2H l {e i(mT - n) ) 


and 


F 1 (e j ‘ oT ) = -2H 0 (e KcoT - Jl) ) 


The factor 2 is required to compensate for the factor 1/2 introduced by the downsampling (see 
Fig. 18.3c). 
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With Eq. (18.17) satisfied, the output of a 2-band QMF bank is given by Eq. (18.16) as 

Y(e J0jT ) = T(e j ‘ oT )X(e jo,T ) 


where 


T(e jaT ) = H 0 (e jloT )H 1 (e KloT - 7Z) ) - H 1 (e jcoT )H 0 (e KwT - 7V) ) (18.18) 

is the overall frequency response of the QMF bank. If we assume that the lowpass and highpass filters 
have frequency responses that are mirror-image symmetric with respect to frequency w = co s /A, then 

H l (e jo>T ) = H 0 (e j{a,T - n) ) (18.19a) 

or 

H l {e KcoT - n) ) = H 0 (e jalT ) (18.19b) 

Hence Eq. (18.18) can be expressed as 

T(e ja>T ) = H^(e ja>T ) - H 2 (e Ka,T ~ 7t) ) (18.20) 


where M(&>) and 0(o>) are the overall amplitude and phase responses of the QMF bank. In practice, 
M(co) should as far as possible be constant and 0(o>) should be a linear function of a> to avoid 
amplitude and phase distortion in the reconstruction process (see Sec. 5.7). 

A transfer function that characterizes the QMF bank can be formed as 

T(z) = H Q (z)H t (-z) - HiWHoi-z) (18.21) 


by letting e jmT = z in Eq. (18.18). 

18.3.3 Design Considerations 

QMF banks can be designed in terms of nonrecursive or recursive biters. Let us consider the brst 
case. 

On assuming that the impulse response of the analysis lowpass biter is symmetrical, its fre¬ 
quency response can be expressed as 

H 0 (e jalT ) = e MN ~ 1)T/2 \H 0 (e ja,T )\ (18.22) 

(see Table 9.1), where N is the biter length. From Eqs. (18.20) and (18.22), we can write 

T(e iaT ) = [|Ho(e 7 “ r )| 2 ± |// 0 (e ;(lu7 ’" 7r) )| 2 ]e 7 '“ (A '" 1)7 ' 

where the plus sign applies in the case where N is even and the minus sign applies in the case where 
N is odd. In effect, linear phase response is achieved, i.e., the design has zero phase distortion. If the 
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required mirror-image symmetry is assumed, the overall frequency response becomes zero at a> = 
(jl> s /A if N is odd. Since T(e''" r ) is required to be an allpass function, we conclude that N must be even. 

A nonrecursive filter can at this point be designed on the basis of the idealized frequency 
response in Eq. (18.11) such that the constraint 

\H 0 (e ja,T )\ 2 + \Ho(e Ka>T ~ 7r) )\ 2 =1 for 0 < co < co s / 2 

is satisfied. Designs of this type can be obtained by using the window technique [14]. 

Nonrecursive QMF banks can also be designed by using optimization methods, as described 
in [15, 16]. One of many possibilities is to construct an error function of the form 

E(x) — £i(x) + aE 2 (x) 

where x is a column vector whose elements are the transfer function coefficients and 

rai s /2 

Ei(x) = / \H 0 (e ja)T )\ 2 dca 

J (O s / 4 

/■“>»/ - 

E 2 (x) = / [\H 0 (e jmT )\ 2 + |// 0 (e^ r - 7r) )| 2 - l] 2 dm 

Ja>,/4 

Minimizing E(x) with respect to the transfer-function coefficients using one of the quasi-Newton 
algorithms described in Chap. 16 will minimize the stopband error in the lowpass filter and force the 
overall amplitude response to approach unity in a least-squares sense. Parameter a can be used to 
emphasize or de-emphasize the error in the overall amplitude response relative to the stopband error 
of the lowpass filter. 

In certain types of recursive filters, it is quite easy to design a pair of complementary filters 
whose amplitude responses assume the form 

H Q {e jmT ) = \[A 0 (. e E° T ) + A x {e^ T )) (18.23) 

and 

H,{e jaT ) = \[A Q {e^ T ) - Ai(e jtoT )] (18.24) 

where Ao(e-' tt>r ) and A i (e- , “ r ) are allpass functions. With these methods, arbitrary amplitude response 
specifications can be obtained and the required symmetry about the frequency co s /A can be easily 
achieved. From Eqs. (18.18) and (18.19), the overall frequency response can be put in the form 

T(e 10>r ) = H$(e ja,T ) - //jV" 7 ') 


and from Eqs. (18.23) and (18.24) 


T{e jaT ) = A 0 (e jroT )A l (e jolT ) 

In effect, the overall frequency response of the QMF bank is an allpass function ’, that is, the design 
obtained has zero amplitude distortion. However, a certain amount of phase distortion will be present. 
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which may or may not be objectionable depending on the application. Such filters can be designed 
as wave lattice filters, as described by Gazsi (see Sec. 17.5 and Ref. [10] of Chap. 17). 


Example 18.2 


Design a 2-band QMF bank as a wave lattice filter using the method described 
in Sec. 17.5 along with an elliptic approximation. 2 The specifications of the lowpass filter are 
as follows: 


A p = 1.0 dB 


A a = 48.3 dB 
= 5,500 rad/s co s = 2.0 x 10 4 rad/s 


= 4,500 rad/s 


■ Solution 

Using the formulas in Tables 12.2 and 12.6, the required selectivity factor is found to 
be k — 0.729454. The minimum filter order that will satisfy the required specifications 
is n — 5, according to Eqs. (10.86)—(10.90). The value of X in the lowpass-to-lowpass 
transformation (see Table 12.1) that will compensate for the warping effect introduced by 
the bilinear transformation can be determined as X = 1.570796 x 10 4 . On using the for¬ 
mulas in Eqs. (10.91)—(10.99) and then applying the lowpass-to-lowpass transformation, 
the denormalized transfer function is obtained as 

I 3 2 , 

1 t— r S + @0 j 

A< ‘ 5 + hoi S 2 + hi jS + b 0 j 

where coefficients a l; - and b,j are given in Table 18.1. 

Now from Eqs. (17.25a) and (17.25b), polynomials d A (s) and ds(s) can be deduced 
as 

d A (s) = (s + hoi)(s 2 + h^s + h 03 ) (18.25) 

and 

<^b( s ) = s 2 + b\2S + ho2 (18.26) 


Table 18.1 Coefficients of H A (s) (Example 18.2) 


j 

a 0j 

b 0 j 

by 

1 

— 

1.918343E + 3 

— 

2 

1.279580E + 8 

1.605501 £ + 7 

2.459931E + 3 

3 

5.951444E + 7 

2.945786E + 7 

6.607256E + 2 

H 0 = 

1.191374E + 2 




2 See Sec. VI of Ref. [17] for a related design example. 
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Digital realizations for networks Na and Nb shown in Fig. 17.14/; can be obtained 
as depicted in Fig. 18.13 by using the approach described in Sec. 17.5. The multiplier 
constants of the adaptors can be calculated from Eqs. (17.29) and (17.30) as follows: 
/xii = 0.536886,/X 12 = 0.432520, /Z 22 = —0.566457, /x 13 = 0.158183, and /X 23 = 
-0.886611. 

The configuration obtained will operate as a halfband lowpass filter with respect 
to output Bo and as a halfband highpass filter with respect to output B\ by virtue of the 
Feldkeller equation (see Sec. 17.5.2). 


A i 



Figure 18.13 Lattice wave digital filter realizing 2-band QMF bank (Example 18.2). 


18.3.4 Perfect Reconstruction 

In the preceding section, it has been shown that designs with zero phase distortion can be easily ob¬ 
tained by using linear-phase nonrecursive filters whereas zero amplitude distortion can be achieved 
by using recursive wave digital biters. In the case of nonrecursive biters, amplitude distortion can be 
rendered insignibcant by using a high-order biter to achieve small passband and stopband ripples. 
On the other hand, in the case of recursive biters, phase distortion can be rendered insignibcant 
through the use of phase equalization (see Sec. 16.8). In this section, a scheme proposed by Smith 
and Barnwell [18] is described by which zero phase distortion as well as zero amplitude distortion 
can be achieved simultaneously independently of the quality of the biters used. 
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4 2 

(b) 



(c) 


Figure 18.14 Required amplitude-response symmetry for perfect reconstruction. 
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Let H(z ) be a linear-phase, lowpass, nonrecursive transfer function and assume that the pass- 
band and stopband errors satisfy the symmetry property 

\\H{e jaT )\ - 1| = \H(e Kc0s/2 - w)T )\ < S (18.27) 

as illustrated in Fig. 18.14a. Using H(z ), a modified transfer function 

H 0 (z) = H{z) + S Z - (N - l)/2 

can be formed, where N is the length of the filter. From the above symmetry property, we can write 

\H 0 (e jaT )\ 2 + \H 0 (e Ka>T ~ Tr) )\ 2 = G = 1 + 28 (18.28) 

where G is a constant, i.e., changes in the two functions cancel each other out exactly, as demonstrated 
in Fig. 18.14a to c. 

A linear-phase transfer function with the amplitude response given by Eq. (18.28) can now be 
constructed as 


T(z) = ~ Hq(z)Ho(z~ 1 )z~^ n ~ 1) - l-Hoi-z-'H-zr^-^Hoi-z) (18.29) 

(see Prob. 18.6), where N is even. On comparing Eqs. (18.21) and (18.29), the assignment 

H,(z) = z,- {N - V) 


can be made and if we let 


F 0 {z) = 2H\(—z) and /q(z) = -2 H 0 (-z) 

a realization of the QMF bank is obtained in which both the amplitude and phase distortions are zero 
at the same time. Realizations of this type are said to have the perfect reconstruction property. 

Halfband filters with the symmetry property of Eq. (18.27) can be designed by using the 
methods described in Chap. 15. 

The above principles can be extended to the design of QMF banks with multiple bands. 


18.4 HILBERT TRANSFORMERS 

In certain digital signal processing applications, it is necessary to form a special version of a given 
signal x(nT), designated as x(nT), with the special property that its frequency spectrum is equal to 
that of x(nT) for the positive Nyquist interval and zero for the negative Nyquist interval, i.e., 3 


X(e ja>T ) = 


X( e j a,T ) 

0 


for 0 < co < a> s /2 
for —a> s /2 < co < 0 


(18.30) 


3 Alternatively, the spectrum ofx(nT) may be taken to be equal to that of x(nT) for the negative Nyquist interval and 
zero for the positive Nyquist interval. 
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Signals with this property have been referred to as analytic signals in the past [19,20] and are useful in 
a number of applications, for example, in single-sideband modulation in frequency-division multiplex 
systems. The motivation for eliminating the spectrum of a signal over the negative Nyquist interval 
is that it is the mirror image of the spectrum over the positive Nyquist interval, i.e., it contains 
the same information, and its elimination reduces the required bandwidth for the processing and/or 
transmission of the signal by half. 

An essential property of real continuous-time signals is that their amplitude spectrums are even, 
and their phase spectrums are odd functions of co (see Prob. 2.16). Since analytic signals violate these 
requirements, they must necessarily be complex of the form 

x(nT) = x r (nT) + jxt{nT) (18.31) 

where x r (nT) and Xi(nT ) are real sequences. If the spectrum of an analytic signal x(nT) is known, 
the spectrums of x r (nT) and Xi(nT) can be readily deduced as 

X r (e ja,T ) = {[X(e’ a,T ) + X*(e- ja>T )] (18.32) 

and 

jX,(e J " jT ) = \[X(e jaT ) - X*(e ~ ja,T )] 

where X* is the complex conjugate of X. These relations are illustrated in Fig. 18.15 
From Eqs. (18.32) and (18.33), we obtain 

X(e j<oT ) = 2X r (e jloT ) - X*(e~ jloT ) 

and 

X(e iaT ) = 2 jXi(e jmT ) + X*(e~ jo,T ) (18.35) 

and since X*(e~ jcoT ) = 0 for 0 < co < coj 2 (see Fig. 18.15b), Eqs. (18.30), (18.34), and (18.35) 
give 

for 0 < co < co s /2 
for — o)j/ 2 < co < 0 

for 0 < co < a> s /2 
for —co s /2 < co < 0 

for 0 < co < co s /2 (18.36) 

On the other hand, from Eq. (18.31) 

X(e iaT ) = X r (e jloT ) + jX t (e J0iT ) 


and 


Thus 


x^ r )= \ 2Xr ^ T) 


x^=\ 2jX ^ T) 


Xi(e Ja)l ) = -jX r (e ia)T ) 


(18.33) 


(18.34) 


DIGITAL SIGNAL PROCESSING APPLICATIONS 853 






Figure 18.15 Derivation of x r (nT ) and x t (nT ) from x(nT) (solid curves represent real parts and dashed 
curves represent imaginary parts). 


and since X(e^ mT ) = 0 for —a> s /2 < co < 0, we have 

Xi(e jcoT ) = jX r (e jaT ) for - co s /2 < co < 0 


Therefore, Eqs. (18.36) and (18.37) can be expressed as 


x.V" 7 ) 


-jX r (e^ T ) 

]X r (e ]mT ) 


for 0 < co < co s /2 
for —co s /2 < co < 0 


(18.37) 
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« x r (n ) 


x(n) 


-o j X j(n) 


Figure 18.16 Synthesis of an analytic signal using a Hilbert transformer, 
or 


X i (e j0,T ) = H(e ja,T )X,fe jo>T ) 


(18.38) 


where 


H{e jmT ) = 



for 0 < co < co s /2 
for — co s /2 < a> < 0 


(18.39) 


These results show that the real and imaginary parts of an analytic signal are interrelated and the 
imaginary part can be obtained from the real part by using Eq. (18.38). This relation may be deemed 
to represent a filter with input x r (nT), output XiinT), and frequency response l Kef"' 1 ). A filter of 
this type is commonly referred to as a Hilbert transformer. Its output xfnT) is said to be the Hilbert 
transform of x r (nT). 

On the basis of these principles, given a real sequence x r (nT), a corresponding analytic signal 
x(nT) can be synthesized by using the configuration depicted in Fig. 18.16. The operation of this 
scheme is illustrated in Fig. 18.17. As can be seen, if x r (n T) is a real sequence and xfnT) is generated 
by using a Hilbert transformer, then x r (nT) + jxf nT) is an analytic signal, as shown in Fig. 18.1 Id. 


18.4.1 Design of Hilbert Transformers 

Hilbert transformers can be designed either in terms of nonrecursive or recursive filters. In the former 
case, either the Fourier series method of Chap. 9 or the weighted-Chebyshev method of Chap. 15 
can be used. 

Using the Fourier series method of Sec. 9.3, the impulse response of a Hilbert transformer can 
be obtained as 


h(nT) = — 
2j[ 


r 0 p—(H s /2 

je ja,nT dw- / je janT dco 
-o>,/ 2 Jo 


2 7 tin 

— sin — for n 0 
nn 2 


(18.40) 


0 


for n — 0 
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Figure 18.17 Operation of configuration in Fig. 18.16 (solid curves represent real parts and dashed curves 

represent imaginary parts). 

Evidently, a Hilbert transformer, like a digital differentiator, has an antisymmetrical impulse response 
and can be designed either with an odd or even filter length N using the window technique described 
in Sec. 9.4. From Table 9.1, we note that for odd N, the amplitude response is zero for to = 0 and 
a) = a) s /2. Hence the useful bandwidth that can be achieved is restricted to some range 0 < cdl < 
to < co H < co s /2 where a>/ and o> H can be made to approach 0 and to s / 2, respectively, as closely 
as desired by increasing N. On the other hand, for even N. the amplitude response need not be zero 
at to = a> s / 2, as can be seen in Table 9.1, and, in this case, Hilbert transformers can be designed in 
which oo h = oo s /2. 
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The ideal response of a causal Hilbert transformer can be expressed in the form e ,mc j D(co) 

where 

(-1 for 0 < w < co s /2 
D(a>) = < 

1 for — a> s /2 < a> < 0 

and c — (N — l)/2. From Table 15.7, we conclude that a Hilbert transformer can be designed using 
the weighted-Chebyshev algorithm. The problem formulation is similar to that used for the design 
of digital differentiators in Sec. 15.9 and is left as an exercise to the reader (see Prob. 18.19). 


Example 18.3 


(a) Design a Hilbert transformer of length N = 21 using the Kaiser window 
with a = 3.0, assuming a sampling frequency of 10 rad/s. (b) Repeat part ( a ) with N = 22 
and compare the results obtained in the two cases. 


■ Solution 

(a) Using Eq. (18.40), the impulse response of the Hilbert transformer, h(n), can be 
computed as shown in column 2 of Table 18.2a. The modified impulse response assumes 
the form 

h w (n) = u>K(n)h(n) (18.41) 

where wk(h) is the Kaiser window. With a = 3.0, Eqs. (9.25) and (18.41) give the 
impulse response in column 3 of Table 18.2a. The amplitude response of the Hilbert 
transformer is depicted in Fig. 18.18a; the maximum passband error is 1.44 percent of 
the passband gain. 

(b) For even N, the impulse response must be antisymmetrical about the midpoint be¬ 
tween samples (N — 2)/2 and N/2, that is, samples 10 and 11 for IV = 22 (see Sec. 9.2.1). 


Table 18.2a Impulse response of Hilbert 
transformer (Example 18.3, part (a)) 


n 

h(n ) = —h(—n) 

h w (n ) 


0 

0.0 

0.0 


1 

6.366198E - 1 

6.289178£ 

- 1 

2 

0.0 

0.0 


3 

2.122066£ - 1 

1.898748£ 

- 1 

4 

0.0 

0.0 


5 

1.273240£ - 1 

9.255503£ 

-2 

6 

0.0 

0.0 


7 

9.094568£ - 2 

4.698992£ 

-2 

8 

0.0 

0.0 


9 

7.073553£ - 2 

2.138270£ 

-2 

10 

0.0 

0.0 
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Consequently, in a noncausal Hilbert transformer, the impulse response is defined at n' = 
±(n — 0.5) with n = 1,2,... , /V/2. Such a design can be obtained by first converting 
the impulse response in Eq. (18.40) into a continuous-time function by letting nT — t 
in h(nT) and then resampling h(t) at t = (n — 0.5 )T for —NT /2 < t < NT /2 where 



(a) 



(b) 

Figure 18.18 Amplitude response of Hilbert transformer (Example 18.3): (a) N = 21, 
(b) N = 22. 
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Table 18.2 b Impulse response of Hilbert 
transformer (Example 18.3, part ( b )) 


11 

h(n) — —hi — 

n) 

h w (n) 


0.5 

6.366198E- 

1 

6.302499 E - 

1 

1.5 

2.122066E — 

1 

2.038026 E - 

1 

2.5 

1.273240E — 

1 

1.161765E - 

1 

3.5 

9.094568E - 

2 

7.713458E - 

2 

4.5 

7.073553E - 

2 

5.447434E - 

2 

5.5 

5.787452E - 

2 

3.94428IE - 

2 

6.5 

4.897075E - 

2 

2.869059E - 

2 

7.5 

4.244132E - 

2 

2.066188E — 

2 

8.5 

3.744822E - 

2 

1.453254E — 

2 

9.5 

3.350630E - 

2 

9.818996E — 

3 

10.5 

3.031523E- 

2 

6.211128E- 

3 


N is the required even integer. On applying this simple transformation to Eq. (18.40), 
we obtain the required impulse response as 


h(n — 0.5) = -h(-n + 0.5) 


2 

(.n — 0.5):r 



(n — 0.5):r 
2 


for n = 1,2,..., N/2 (18.42) 


Similarly, by sampling the continuous-time Kaiser window at t = (n — 0.5)7’ 
for —NT/2 < t < NT/2 with N — 22 using Eqs. (7.24) and (7.25), the values of 
Wg(n — 0.5) = wx(—n + 0.5) can be computed, and from Eqs. (18.41) and (18.42) the 
design in Table 18.2 b can be readily obtained. The amplitude response for this case is 
depicted in Fig. 18.18h; the maximum passband error in this case is 0.36 percent of the 
passband gain. We note that for odd N, several values of the impulse response are zero, 
which renders the design more economical. However, the design for even N provides a 
wider bandwidth and the approximation error is much smaller. 

A feature of the latter design, which may be a problem in certain applications, 
is that the impulse response must be shifted by a noninteger multiple of the sampling 
period in order to achieve a causal design. 


The frequency response of a Hilbert transformer can also be expressed as 

H(e i<oT ) = M(co)e iHa>) 


where 


M(a>) = 1 


and 


0(oj) = 



for 0 < co < co s /2 
for —a> s /2 < co < 0 


according to Eq. (18.39). Hence Hilbert transformers can also be designed as recursive filters by 
assuming a set of cascaded allpass sections, as in Sec. 16.8, and then forcing the overall phase response 
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to approach —90° for the range 0 < a> < a> s /2 and 90° for the range —a> s /2 < to < 0 to within a 
prescribed tolerance. This can be done by using the optimization methods described in Chap. 16. 

18.4.2 Single-Sideband Modulation 

One of the important applications of Hilbert transformers is concerned with single-sideband modula¬ 
tion. This process involves two steps: first, an analytic version of a real signal is generated; second, it 
is used to modulate a sinusoidal carrier of frequency co c . Single-sideband modulation can be carried 
out by using the scheme depicted in Fig. 18.19, as will now be demonstrated. 

The signals at nodes A and B in Fig. 18.19a constitute an analytic signal given by 

x(nT ) = x r (nT) + jxi(nT ) 

= A{nT)e mm (18.43) 


cos co c nT 



sin a) c nT 



Figure 18.19 Single-sideband modulation: (a) Generation of real sequence, ( b) generation of imaginary 
sequence. 
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where 

A(nT ) = [x 2 0 iT) + xf(nT) 1 and cp(nT) — tan” 1 ———- 

x r (nT) 

Hence the outputs of the top and bottom structures are given by 

y r (n) = A(nT) cos[co c nT + (p(nT)\ 


and 


respectively. Therefore, 


y,(n) = A(nT) sm[w c nT + <p(nT)] 


y(nT) = y r (n) + jyi(n) 

and, if the spectrum of x(nT) (see Eq. (18.30)) is assumed to be zero for &>»,<&>< co s /2 and 
a) c + oj m < cos/2 , then the spectrum of y(jiT) is given by 

Y(e ja,r ) = X(e j(0, -‘ 0c)T ) for 0 < a> < u> s /2 (18.44) 

(see Prob. 18.20). In effect, y{nT ) represents a carrier modulated by the upper sideband of signal 
x r (nT). The operation of the modulator is illustrated in Fig. 18.20. A simplified realization of the 
modulator can be easily obtained from Fig. 18.19, as depicted in Fig. 18.21. 




Figure 18.20 Operation of single-sideband modulator (solid curves represent real parts and dashed curves 
represent imaginary parts). 
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cos co c nT sin co c nT 



Figure 18.21 Simplified single-sideband modulator. 


18.4.3 Sampling of Bandpassed Signals 

In certain applications, it is necessary to sample a signal x(t) whose spectrum occupies a frequency 
interval io L < w < a> H ■ Signals of this type are often generated through the use of bandpass filters 
and can be referred to as bandpassed 4 signals. The processing of such signals would necessitate a 
minimum sampling frequency co s = 2o> H , according to the sampling theorem. However, through the 
use of a Hilbert transformer and a pair of decimators, it is possible to generate a downsampled version 
of the signal that can be processed at a much lower sampling frequency. Such a scheme is shown in 
Fig. 18.22a, and its mode of operation is illustrated by the frequency spectrums of Fig. 18.23. 

The signal components at nodes A and B in Fig. 1 8.22 a represent an analytic signal x(nT) with 
the frequency spectrum depicted in Fig. 18.23&, as demonstrated earlier. Now if M — hit (a> s /B ), 
where B = (coh — o>l), the downsamplers will produce exactly M copies of the spectrum of x(nT) 
in the interval —a) s /2 < a> < co s / 2, as illustrated in Fig. 18.23c for the case M = 8. As can be seen, 
the information content of the signal now occupies the interval —B /2 < co < B /2 and the signal 
can be processed using a sampling frequency B. For a narrowband signal, we have B 2a> H and, 
therefore, the necessary speed of operation of the hardware is significantly reduced. 

The processed bandpassed signal can be recovered by reversing the above procedure using the 
configuration of Fig. 18.22 b, where the bandpass filter is a complex bandpass filter with a frequency 
response 


H(e imT ) = 



for co L < co < co H 
otherwise 


4 Some authors refer to such signals as bandpass signals but “bandpass” is normally used to qualify filters or systems. 
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X d ( nT ') 


j 


(a) 


x du (nT ') 


x d (nT') 



Xj(nT") = x(nT) 


(b) 


Figure 18.22 Processing of bandpassed signals: (a) Sampling, ( b) reconstruction. 


The operation of this scheme is illustrated by the frequency spectrums in Fig. 18.24. Upsampling 
will produce M — 1 images of the spectrum of x(nT), as shown in Fig. 18.24/?, and the desired image 
can be selected by the bandpass filter, as depicted in Fig. 18.24<r/. 


18.5 ADAPTIVE DIGITAL FILTERS 

In many applications, time-variable filters whose characteristics can be varied with time are required. 
Filters of this type can be obtained by using multipliers with time-variable coefficients. A time- 
variable filter that incorporates some adaptation mechanism by which the multiplier coefficients can 
be adjusted on line so as to optimize some performance criterion is said to be an adaptive filter 
[5-8]. The adaptation mechanism usually incorporates an optimization algorithm that evaluates the 
instantaneous values of the multiplier coefficients such that some norm of an error function of the form 

e(n) = d{n) - y(n) (18.45) 

is minimized, where d(n) is some desired reference signal and yin ) is the filter output. A typical 
adaptive-filter configuration is illustrated in Fig. 18.25. 

The design of adaptive filters involves the choice of filter structure, the specific error norm to 
be used as objective function, and the type of adaptation algorithm [21-27]. The structure can be 
nonrecursive or recursive; the objective function may involve the expected amplitude or square of the 
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(b) 



error and possibly the expected value of some higher power or the maximum of the error; similarly, 
the adaptation algorithm can be one of several possibilities. Like other filters, adaptive filters are 
required to be economical, fast, and insensitive to finite word-length effects; in addition, they should 
adapt in a short period of time, and the residual error after adaptation should be as small as possible. 
Hence, the performance criteria for these filters are the simplicity and properties of the structure, and 
the flexibility, reliability, computational complexity, and convergence properties of the adaptation 
algorithm employed. 

Usually, the most well behaved of the possible objective functions involves the square of the 
error (e.g., the mean-square error), which can be minimized very quickly using some relatively 
simple optimization algorithms. As a consequence, this objective function is preferred, although a 
mean-square solution may not be the most appropriate in certain applications. 
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(b) 




Figure 18.24 Operation of scheme in Fig. 18.22 b. 
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d(n) 



Figure 18.25 Typical adaptive-filter configuration. 


In the next section we examine an optimal class of digital filters that are designed by choosing 
the transfer-function coefficients such that the mean-square value of an error function of the type 
given in Eq. (18.45) is minimized for some desired response din). Filters so designed are commonly 
referred to as Wiener filters, and optimization algorithms that can be used for their design can often 
be implemented as adaptation algorithms. 


18.5.1 Wiener Filters 

The simplest structure that can be used for adaptive filters is the direct nonrecursive structure of 
Fig. 18.26. The output of this configuration is given by 


N -1 

y(n) = ^ cii(n)x(n - i) = ajx„ 
i =o 


(18.46) 


x{ri) < 


e(n) 


Adaptation 

algorithm 




Figure 18.26 Nonrecursive adaptive-filter configuration. 
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where 


x„ = [x(n) x(n — 1) • • ■ x[n — (N — 1 )]] r 


and 


a„ = [a 0 (n) ci\(n) ■ ■ ■ a N -\(n)] T 

are the input signal and coefficient vectors, respectively, at instant nT. 

The mean-square error (MSE) is defined as 

^(a,,) = E[e\n)] (18.47) 

where £[•] is the expected value of [■]■ From Eqs. (18.47), (18.45), and (18.46), we can write 
^(a„) = E[d 2 (n) - 2d(n)y(n) + y 2 («)] 

= E[d\n) - 2d(n)a' n Xn + a^x„xja„] 

= E[d 2 (n)\ - 2E[d{n)a T n x n \ + E [a[x„x^a„] 

For a filter with fixed coefficients, the MSE function is given by 

*(a„) = E[d\n)} - 2ajp„ + a[R„a„ (18.48) 

where 

p„ = E[d(n)x n ] 


and 

R„ = E[x n x T n ] 


are the cross correlation between the desired and input signals and the correlation matrix of the 
input signal, respectively, at instant nT. In effect, the objective function in Eq. (18.47) is a quadratic 
function of the filter coefficients ao(n), afin), ..., ajv_i(n). 

The gradient vector of the MSE function can be readily expressed as 


g„ = V'Fia,,) 


"h( a, I 9M>(a„) 

dao(n) dafin) 


3^(a„) 

da N -i(n) 


(18.49) 


and from Eqs. (18.48) and (18.49) 


g„ = — 2p„ + 2R„a„ (18.50) 

Now on equating the elements of the gradient vector to zero, the coefficient vector that minimizes 
the MSE function, say a, can be deduced as 


a = R„ p, 
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Evidently, if p„ and R„ are known the Wiener solution can be readily obtained. In practice, accurate 
estimates of p„ and R„ are not always available, but time averages may be used for their estimation if 
d{n ) and x(n) are stationary and ergodic signals. In such applications, p„ and R„ represent a constant 
vector and a constant matrix, respectively, and the subscript n can be dropped. 

Many of the available adaptation algorithms are practical algorithms that lead to the Wiener 
solution and are borrowed from the field of optimization. Commonly used algorithms are based on 
the Newton and steepest-descent algorithms. 

18.5.2 Newton Algorithm 

The Hessian matrix of \&(a„) can be obtained from Eq. (18.50) as H„ = 2R„ and, therefore, the 
Newton direction (see Sec. 16.3) can be determined as R“'g,,/2. The Wiener solution can, therefore, 
be approached by obtaining estimates of a„+i such that 

a„+i = a„- a R,7'g„ (18.51) 

for n = 0, 1, ..., where a is a constant, g„ is an estimate of g„, and ao is an initial estimate of 
the transfer-function coefficients. The algorithm is terminated when some convergence criterion is 
satisfied. This algorithm is essentially the basic Newton algorithm described in detail in Sec. 16.3 
except that no line search is used. The constant a, which is sometimes called the convergence factor, 
is chosen to achieve fast convergence for the type of application under consideration. Line searches 
have not been used in the past owing to the additional amount of computation required, but certain 
related techniques are likely to be employed in the future. 

If g„ in Eq. (18.51) is the exact gradient, matrix R„ is a well-behaved positive-definite matrix, 
and a = 1/2, then the Newton algorithm gives the required solution in one iteration, as was demon¬ 
strated in Sec. 16.3. However, if g„ is an approximate estimate of the gradient, a number of iterations 
is required. 

In practice, the Newton algorithm is characterized by a very small number of iterations, but 
the amount of computation required per iteration is quite large since the inversion of matrix R„ is 
required. If R„ is nearly nonsingular or ill-conditioned, the algorithm can become quite inefficient. 


18.5.3 Steepest-Descent Algorithm 

If matrix R„ is assumed to be the N x N unity matrix, then the updating formula in Eq. (18.51) 
assumes the form 


a„+i = a„ - a g„ (18.52) 

If the negative of the gradient vector, namely, — g„, is drawn through point a„, it points in the direction 
of steepest descent, as can be easily shown, and for this reason the use of Eq. (18.52) as updating 
formula leads to the so-called steepest-descent algorithm. 

This algorithm is very simple to implement since the Hessian matrix and its inversion are not 
required. At the start of the adaptation, the algorithm leads to a large reduction in the error function 
per iteration. However, as the solution is approached, the elements of the gradient become smaller 
and smaller and progress in the adaptation process tends to slow down considerably; in particular, if 
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the minimum point is located in the middle of a relatively flat valley. Overall, the steepest-descent 
algorithm is usually less efficient than the Newton algorithm, but the amount of computation per 
iteration is much smaller. This makes the steepest-descent algorithm more suitable for real-time 
applications. 

If the ratio of the largest to the smallest eigenvalue of matrix R„ is large, then the solution point 
tends to follow a zig-zag trajectory in the parameter space and the performance of the algorithm 
tends to deteriorate. Under certain circumstances, the algorithm can actually become unstable, as 
demonstrated by the following example. 



(a) Show that the steepest-descent algorithm can be treated as an /V-input, 


iV-output, first-order digital filter, (b) Using the filter obtained, find a necessary and sufficient 
condition for the stability of the algorithm. 


■ Solution 


(a) From Eqs. (18.52) and (18.50) 


a.: ■ i - k U;; * 2(Y p ;j 


(18.53) 


where 


R 1 2a R„ 


Matrix R„ can be expressed as 


R„ = QAQ r 


where Q is a unitary matrix whose columns comprise an orthogonal set of eigenvectors 
associated with the eigenvalues of R„ and A is a diagonal matrix whose diagonal elements 
are the eigenvalues of R„. Hence Eq. (18.53) can be put in the form 


a?;) i — QAQ a,, -(- 2a p. 


and on premultiplying both sides by Q T and letting 


aj, + i = Q r a„+i and p,', = 2a Q 7 p„ 


we obtain 



(18.54) 
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Figure 18.27 IV-input, N -output, first-order digital filter (Example 18.4). 

This equation represents an /V-input, /V-output, first-order digital filter with input x„ = p' n 
and output y„ = aj 1+1 , as shown in Fig. 18.27. 

(b) The algorithm is stable if and only if each of the elements of the impulse res¬ 
ponse vector h„ of the filter in Fig. 18.27 is absolutely summable (see Sec. 4.7). From 
Eq. (18.54) 

h 0 = a, = Aa[) + 6 0 

Im = a' 2 = Aa'j + 0 = A 2 ag + A<5 0 

h 2 = a' 3 = Aa 2 + 0 = A 3 ag + A 2 (5 0 

h„ = < +1 = A" +1 ao + A"<5 0 

Without loss of generality, we can assume that ao = 0 or a^ = 0 and hence 

h„ = A"<5o 

Thus, the ith element of the impulse response vector h„ is obtained as 

hi(n) = X" (18.55) 
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The filter is stable if and only if 


oo 


\hi(ri)\ < oo for ; = 1,2,., N 


(18.56) 


n= 0 


and, therefore, a necessary and sufficient condition for stability can be obtained from 
Eqs. (18.55) and (18.56) as 


|A,-[ < 1 for i = 1, 2, ..., N 


(18.57) 


Now the eigenvalues of R,, are related to those of R„ by the equation 

X/ = 1 — 2a A 

(see Prob. 18.21) and hence the inequality in Eq. (18.57) can be expressed as 
11 — 2 aXi | < 1 for i = 1, 2,..., IV 

Since the eigenvalues of R„ are real and positive, the steepest-descent algorithm is stable 
if and only if 


0 < a < 1/A. 


where A is the largest eigenvalue of R„. 


Improved performance can often be achieved, in practice, by starting the adaptation process 
with the steepest-descent algorithm and, when certain progress has been achieved, switching over 
to the Newton algorithm, which is more efficient at points in the neighborhood of the solution 
point. 

18.5.4 Least-Mean-Square Algorithm 

As can be seen in Eq. (18.50), the gradient depends on vector p„ and matrix R„, which are not in 
general available. Nevertheless, an estimate of the gradient g„ can be deduced by letting 


Pn = d(n)x„ 


(18.58) 


and 


R — x x r 

iV /7 — A n A n 


(18.59) 
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be estimates of p and R, respectively. From Eqs (18.50), (18.58), (18.59), (18.45), and (18.46), we 
can write 


g „ = -2 d(n)x„ + 2x n x' n a„ 

= -2 [din) - xja„]x„ 

= —2e(«)x„ (18.60) 

On using this estimate of the gradient in the updating formula of the steepest-descent algorithm given 
in Eq. (18.52), we obtain 


a„+i = a„ + 2a e(n)x„ (18.61) 

The use of this formula yields the so-called least-mean-square (LMS) algorithm. The convergence 
factor a is chosen in the range 


0 < a < 


1 

NE[x 2 (n)] 


(18.62) 


in order to guarantee the convergence of the algorithm (see Prob. 18.23). The quantity E[x 2 (n)] 
represents the average input power and is usually easy to estimate. 

Note that 


de(n) d e(n) de(n ) 

dao(n) dai(n) daN-i(n) 

and from Eqs. (18.45), (18.46), and (18.60) 

Ve 2 (n) = —2e(n )x„ = g„ 

that is, g„ is the exact gradient of e 2 (n) and thus the LMS algorithm minimizes the instantaneous 
power of the error signal. 

Further details on the above algorithms as well as some others can be found in [5-8]. 

18.5.5 Recursive Filters 

In applications where high selectivity is required, a nonrecursive design would necessitate a transfer 
function of high order, which may entail a high computational complexity. For such applications, 
a recursive design may be the only possible solution. Unfortunately, however, the use of recursive 
structures introduces several new problems. First, the coefficients of the denominator polynomial of 
the transfer function may assume values in the unstable region of the coefficient space and, if this 
happens, the adaptive filter will become unstable. Second, the objective function becomes highly 
nonlinear and may have several local minima, some of them quite shallow. Flence the adaptation 
algorithm may easily converge to some unsatisfactory solution. 

The problem of instability can be overcome by incorporating checks in the adaptation algorithm 
that can detect an unstable solution and restore stability by making a suitable adjustment to the current 


Ve 2 (n) = 2e(n) 








872 DIGITAL SIGNAL PROCESSING 


coefficient values. For example, the coefficients can be adjusted in such a way as to replace any poles 
outside the unit circle of the z plane by their reciprocals (see Sec. 11.4). The problem of several local 
minima, which is quite difficult to solve, can be eased to some extent by selecting a well-behaved 
objective function and by using a good estimate of the solution for the initialization of ao- For 
most practical problems, the objective function is well behaved in the neighborhood of the optimum 
solution, and an initial point in this domain will cause the adaptation algorithm to converge to the 
optimum solution. 

The design of adaptive filters based on recursive structures has been studied by a number of 
researchers in recent years [26-27] and more work is anticipated in the future. 

18.5.6 Applications 

The applications of adaptive filters are numerous and include system identification, channel equal¬ 
ization, signal enhancement, and signal prediction. 

In a system identification application, a broadband signal, usually white noise, is applied si¬ 
multaneously at the inputs of an unknown system and an adaptive biter, and an error signal is formed 
by subtracting the output of the adaptive biter from that of the unknown system, as depicted in 
Fig. 18.28. If the error signal obtained is minimized, the adaptive biter becomes a model for the 
unknown system. 

The transmission of a signal through an imperfect channel entails amplitude and phase distor¬ 
tion, as was shown in Sec. 5.7. If the frequency response of the channel is known, it can be equalized 
using a bxed biter, as described in Secs. 12.5.1 and 12.6. However, if the channel response is vari¬ 
able, equalization by means of an adaptive biter is more appropriate. A variable channel response 
can occur in telephony where the physical wire path between any two subscribers depends not only 
on the locations of the two subscribers but also on the time of the call. Channel equalization can 



Figure 18.28 Use of adaptive filters for system identification. 
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Figure 18.29 Use of adaptive filters for channel equalization. 


be achieved by connecting an adaptive filter in cascade with the channel and comparing the output 
of the cascade arrangement with a delayed version of the input signal, as illustrated in Fig. 18.29. 
In this application, the reference signal is a training signal and is known at the receiving end, i.e., it 
need not be transmitted. 

In signal enhancement applications, a signal x[n) corrupted by a noise component n \ (n), 
namely, 


d{n) = x(n) + rt\(n) 

is used as a reference signal, and a signal « 2 («) that is correlated to the noise component n \ (n) is 
applied to the input of an adaptive filter, as depicted in Fig. 18.30. After adaptation, the error signal 
e(n) will represent an enhanced version of the signal x(n ) in which a significant amount of noise has 
been removed. 

In signal prediction applications, the signal of interest is used as the reference signal and a 
delayed version is applied to the input of an adaptive filter. The error signal is generated by subtracting 
the output of the adaptive filter from the reference signal, as shown in Fig. 18.31. After convergence. 



Figure 18.30 Use of adaptive filters for signal enhancement. 
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Figure 18.31 Use of adaptive filters for signal prediction. 

the filter coefficients are adjusted in response to the past signal values and can, therefore, be used 
to reconstruct or extrapolate the input signal. Signal prediction is used in speech coding, where a 
model of the signal rather than the signal itself is encoded and transmitted. 


18.6 TWO-DIMENSIONAL DIGITAL FILTERS 


In many applications, continuous signals are encountered that are functions of two independent 
variables, say, t\ and f 2 . Two-dimensional signals of this type can be represented by functions of the 
form x(t i, h). Each of the two variables can represent an arbitrary physical quantity such as time, 
length, velocity, acceleration, and temperature. An example of a 2-D continuous signal is the light 
intensity in an image as a function of the x and y coordinates. 

Two-dimensional continuous signals, like their 1-D counterparts, can be represented by fre¬ 
quency spectrums. Furthermore, they can be sampled at discrete points (t \, to) = (n\T\, n 2 To) to 
yield discrete 5 signals x(«i7j, no'IY)- Signals of this type have frequency spectrums that are peri¬ 
odic with respect to frequencies u>\ and co 2 with a 2-D period (cu,i, co s 2 ), where co s \ = 2n /7j and 
(jl > s2 = 2jt/T 2 . 

Two-dimensional discrete signals can be processed by 2-D digital filters whose operation and 
properties are analogous to those of their 1-D counterparts, that is, they can be time invariant or 
time dependent, causal or noncausal, and linear or nonlinear. Since neither of the two independent 
variables needs to be time, causality does not have the usual physical interpretation. 

The theory, analysis, and design methods, and applications of 2-D digital filters are quite 
extensive but are largely beyond the scope of this book. Below, we present some of the basic 
principles involved and some of the straightforward extensions of 1-D methods and techniques for 
the sake of completeness. The reader with more than a casual interest in the analysis and design 
of 2-D digital filters is referred to the more specialized books on the subject cited earlier, namely. 
Refs. [9-11]. 

A 2-D causal recursive (or HR) digital filter with excitation x(n \, no ) and response y(n \, n 2 ) 
can be represented by a difference equation in two variables of the form 



5 Discrete-time is changed to discrete since neither of the two variables needs to be time. 
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where b (n) = 0. If b, j = 0 for 0 < i < N\ and 0 < j < N 2 , the representation of a 2-D nonrecursive 
(or FIR) hlter is obtained. The pair (N\ , N 2 ) is the order of the filter. 

18.6.1 Two-Dimensional Convolution 

If the impulse response of a 2-D filter h{n\nf) is known, then its response yin \. 11 2 ) to an arbitrary 
excitation x(ni, n 2 ) can be determined by using the 2-D convolution. If bin \ , n 2 ) = xin \. n 2 ) — 0 
for n\ < 0 or «2 < 0, then 


«1 «2 

y(ni,n 2 ) = EE x(i, j)h(n 1 - ;, n 2 - j) 

i= 0 j =0 
n\ n 2 

= E E h(i ’ 1 - *’ " 2 - 7 ) 

<=0 y =0 

This formula can be derived by following the approach of Sec. 4.6. 

18.6.2 Two-Dimensional z Transform 

The most important mathematical tool for the analysis and design of 2-D digital filters is the 2-D 
Z transform, which is a straightforward extension of its 1-D counterpart. The 2-D z transform of a 
function f(n\, nf) is defined as 


OO OO 

f(z\, z 2 ) = ^2 /(«t>«^rv 2 

H\= — OO II2——00 


for all (zj, z 2 ) for which the double summation converges. Function fin 1 , n 2 ) is the 2-D inverse z 
transform of F{z \, z 2 ) and is given by 

f(n\,n 2 ) = ^ j j> F(zuZ 2 )zT~ 1 z 2 2 ~ 1 dzidz 2 (18.63) 

where the two integrals are evaluated in the counterclockwise sense over contours T 1 and T 2 that are 
in the region of convergence of F(zi, Z 2 ) ■ 


18.6.3 Two-Dimensional Transfer Function 

The transfer function of a 2-D digital hlter is the z transform of the impulse response, as can be 
shown by applying the z transform to the convolution summation. It can be expressed as 


H(z\,z 2 ) 


N(zi, zf) 
D(zi,zi) 


EEE -Lod 


Ni-i N 2 -j 
ij z 1 4 2 


« 2 1 V 2 h- 7 -‘ ■ 7- 

*■1 z 2 X- 2_ji = o Z^/=0 z 2 


Ni-iN 2 -j 


where boo = 0. The transfer function can be used to find the response of the hlter to an arbitrary 
excitation and its frequency-domain response; furthermore, it contains all the necessary information 
to determine whether the hlter is stable or unstable. 
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18.6.4 Stability 

The stability of a 2-D digital filter is closely linked with the singularities of the transfer function, as 
in 1-D filters. Unfortunately, in 2-D digital filters the singularities are not in general isolated and, 
as a result, stability analysis is much more complicated. A sufficient condition for the stability of a 
2-D filter due to Shanks [28, 29] is that all the singularities of the transfer function are located on 
the open unit bidisc defined by the set 


U 2 = {{ZUZ2) - |Zll < l,|Z2l < 1} 


D(zuZi) / o for (z i, Z 2 ) £U 2 


(18.64) 


where 



with boo = 0. 



A 2-D digital filter is characterized by the transfer function 



where 


N(zi, zi) = 512(zi + l) 2 (z 2 + l) 2 


and 


D(zu Zi) = 512^z? - 128ziz? + 256z\z 2 - 192^ - 40 - 64 ziz 2 
+ 10zi - 96 z2 + 15 


Check the stability of the filter. 


■ Solution 


The transfer function can be expressed as 



where 


W'(Z1,Z2) = (Z1 + 1) 2 (Z2 + 1) 2 
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and 



The denominator polynomial D'(zi, Zi) can now be put in the form 



Hence the transfer function H(zi, Z 2 ) is singular only at points 



Therefore, D(z 1 , Z 2 ) satishes Eq. (18.64) and as a consequence the filter is stable. 


If the denominator of the transfer function can be factorized into a product of polynomials 
of the form T>i(zi)T> 2 fe) where £>i(zi) and /Afe) are polynomials in zi and Z 2 , respectively, as 
in the above example, the stability of the filter can be easily checked by using the stability criteria 
of Sec. 5.3.3, for example, by applying the Jury-Marden stability criterion. However, if I)(z\ , Z2) 
cannot be factorized, the stability analysis can be quite involved (see Chap. 5 of Ref. [11]). 

18.6.5 Frequency-Domain Analysis 

The frequency response of a 2-D biter is given by 


H(e ja>lTl , e jWlT2 ) = M(co U Qj 2 )e Mlo, ’ l02) 


where 


e jlD2T 2 ^ 


CO 2 ) = | H(e 


(18.65) 


and 


6(a)i, C 02 ) — arg H{e ,0> ' T ', e 7 ® 2 ^) 


(18.66) 


are the amplitude and phase response, respectively. A pair of parameters that are sometimes of interest 
in 2-D digital biters are the group delays. These are debned as 


dO(a )\, 022 ) 


dd(a>i , a> 2 ) 


dco 1 


da>2 


H = - 


and 


T-2 — 


(18.67) 
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Example 18.6 


A 2-D nonrecursive digital filter designed by using the method in Ref. [30] 
has the transfer function 


4 

H(zuZ2) = ^2(-D i+lH i(Zl) H i(Z2) 
1 = 1 


where 


24 

H,(zk) = ^2 a iJ z k j for k — L 2 

1=0 


and 


ciij = a,-( 24 -/) for i = 1,2, 3, 4 (18.68) 

The coefficients are given in Table 18.3. Obtain the amplitude response of the filter. 


Table 18.3 Coefficients of 2-D transfer function (Example 18.6) 


j 

ay 

a 2j 

a 3j 

a *j 

0 

0.0007 

0.0012 

0.0031 

0.0027 

1 

-0.0004 

-0.0009 

0.0006 

0.0034 

2 

-0.0013 

-0.0033 

-0.0065 

-0.0063 

3 

0.0022 

0.0043 

-0.0009 

-0.0099 

4 

0.0025 

0.0105 

0.0173 

0.0155 

5 

-0.0086 

-0.0119 

-0.0019 

0.0301 

6 

-0.0036 

-0.0206 

-0.0474 

-0.0109 

7 

0.0241 

0.0374 

-0.0154 

-0.0460 

8 

-0.0007 

0.0549 

0.0746 

-0.0214 

9 

-0.0688 

-0.0713 

0.0744 

-0.0007 

10 

0.0189 

-0.1635 

0.0015 

-0.0137 

11 

0.3145 

-0.0519 

-0.0028 

-0.0049 

12 

0.4935 

0.0544 

0.0250 

0.0124 


■ Solution 

The amplitude response can be obtained as shown in Fig. 18.32, by using Eq. (18.65). 
As can be seen, the given transfer function represents a lowpass filter with a circular 
passband. Equation (18.68) amounts to symmetrical impulse responses in the 1-D filters, 
represented by H\{z\) and 1 / 2 ( 22 ), that is, these filters have a linear phase response (see 
Sec. 9.2). Therefore, the phase response of the 2-D filter, given by Eq. (18.66), is linear 
with respect to both an and an, and the group delays in Eq. (18.67) are constant throughout 
the baseband. It should be mentioned in passing that a linear phase response is highly 
desirable in image processing applications. 
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Figure 18.32 Amplitude response of 2-D digital filter (Example 18.6): (a) 3-D plot, 
(b) contour plot. 
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18.6.6 Types of 2-D Filters 

As in the case of 1-D filters, different types of 2-D filters can be identified on the basis of their 
amplitude responses, e.g., lowpass, highpass, bandpass, and bandstop. Passbands and stopbands are 
now subareas of the (co\w 2 ) plane and can be rectangular or circular. A 2-D lowpass filter has an 
amplitude response of the form 


co 2 ) 


1 for (<i>i, a) 2 ) e Ri 

0 for (a> 1 , C 02 ) e R 2 


where 


R\ = {(o)i,a> 2 ): |tt>i| < w p \ and \m 2 \ < co p2 } 


and 


R 2 = {(coi, co 2 ): |«i| > tti a i or |® 2 | > W fl 2 } 


in a filter with rectangular band boundaries or 


R\ = ^(cur, <w 2 ): \J<*>\ + 


a>o < a> L 


and 


Ri 


(coi,w 2 ): \]co\ + 


> W a 


in a filter with circular band boundaries. A 2-D highpass filter, on the other hand, has an amplitude 
response 


M(co \, (v 2 ) 


0 for (a>i, a) 2 ) e Ri 

1 for (a> 1 , u> 2 ) e R 2 


where R\ and R 2 are as above. 

Another type of filter that has no counterpart in the 1-D domain is the so called fan filler. A 
fan filter has an amplitude response 


where 


, co 2 ) 


for (a>i, a> 2 ) e Si 
for {cd\ , u> 2 ) e S 2 


Si = < ( <d\ , co 2 ): 


_1 (02 

tan — 

(o 1 


< 0\ or 


_i (02 

tan — 
co\ 


> 7T 
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and 


S 2 


|(cdi, ®2): 


_I ®2 

tan — 

> 0 2 or 

_I ®2 

tan — 

o>i 


«1 


< IT - 02 


with 02 > 6\. 

18.6.7 Approximations 

The most difficult task in the design of 2-D digital filters is the solution of the approximation problem, 
which entails the derivation of a stable transfer function such that prescribed amplitude and/or phase 
response specifications are achieved. As in 1-D filters, the approximation problem can be solved by 
using direct or indirect methods in terms of closed-form or iterative solutions. 

Nonrecursive filters can be designed by using the 2-D Fourier series in conjunction with 
2-D window functions [31] (see Secs. 9.3 and 9.4) or by using a transformation due to McClellan 
[32, 33]. Recursive filters, on the other hand, can be designed by applying transformations to 1-D 
filters [34, 35]. Nonrecursive as well as recursive filters can be designed by using the singular-value 
decomposition [30, 36] or through the application of optimization methods [37-40]. 

If the numerator and denominator of the transfer function can be factorized into products 
N\ (zi )N 2 ( 7 . 2 ) and D\(zi j/Ufo). then the transfer function is said to be separable and can be expressed 
as 


H(z\,Zl) = Hiizu Z2)H 2 (Zl,Z2) 


where 


Hi(zu z 2 ) = 


N\(z\, z 2 ) 
D\(z\, Z 2 ) 


and 


Hiizu z 2 ) 


N 2 (zi, z 2 ) 
D 2 (zu z 2 ) 


Filters of this class can be readily designed using the approximation techniques for 1-D digital filters 
described in the previous chapters, and they are suitable for applications where rectangular band 
boundaries are acceptable. However, if the transfer function is not separable, as may be the case in 
filters with circular band boundaries, the design is much more involved. 


18.6.8 Applications 

Two-dimensional digital filters are useful in several areas. Lowpass filters can be used for the reduction 
of noise in images for the same reasons as their 1-D counterparts. Use is made of the fact that the 
information content of the 2-D signal is often concentrated at low frequencies, whereas noise tends 
to be distributed throughout the baseband. Highpass filters are sometimes used for the enhancement 
of edges in images ; their application is based on the fact that abrupt changes in an image tend to 
increase the high-frequency content of an image, and its amplification by a highpass filter tends to 
exaggerate edges or outlines. Edge enhancement finds applications in pattern recognition, surveying, 
and computer vision. Fan filters have been found very useful for the processing of geophysical signals; 
for example, they can enhance the quality of seismic signals by eliminating signal components that 
are not associated with the subsurface ground formations. Seismic signals are indispensable for oil 
prospecting and other geological applications [11]. 
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PROBLEMS 

18.1. The input signal x(nT ) in the downsampler of Fig. 18.2a has the real frequency spectrum depicted in 
Fig. P18.1 and co s = 20 rad/s. 

(a) Sketch the frequency spectrum of x d (nT') if M = 2. 

(b) Repeat part (a) if M = 4. 

(c) Comment on the answers obtained in parts (a) and (b). 



Figure P18.1 


10 


20 
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18.2. Repeat Prob. 18.1 if the spectrum of x(nT) is given by 


X(e jo,T ) = 9ie X(e ja,T ) + j 3m X(e io>T ) 


where 


meX(e iolT )= j* 16,1 


for —1 < cd < 1 
for 1 < |a>| < 10 


and 


3 m X(e io,T ) = 


—a> for — 1 < co < 1 
0 for 1 < \oo\ < 10 


The sampling frequency is the same as in Prob. 18.1. 

18.3. The spectrum of signal x(nT) in the downsampler of Fig. 18.2a is given by 


X(e iwT ) = e~ H for 0 < \a\ < 12 


and co s = 24 rad/s. Find the maximum value of M that will limit the aliasing error to a value less than 1 
percent relative to the spectrum of the signal at co = 1 rad/s. 

18.4. In an application, the sampling frequency needs to be increased by a factor of 10. 

(a) Design a nonrecursive filter that can be used along with an upsampler to construct an interpolator. 
Linear interpolation is acceptable. 

( b) Plot the amplitude response of the filter. 

18.5. A signal x{nT) is applied at the input of the configuration depicted in Fig. PI8.5a. The frequency 
spectrum of x c (t), namely, X c (jco), is zero for \a>\ > a> c , as illustrated in Fig. P18.5ft. The filter shown 
is a nonrecursive filter of length N with a frequency response 


H(jco) = M(co)e iB(m) 


where 



for \co\ < co c 

for cx> c < \co\ < co'Jl 


and 


0(oo) = (N - l)coT'/2 


(a) Sketch the frequency spectrums at points A, B, C, and D. 

(b) Write expressions for the signals and their frequency spectrums at points A, B, C, and D. 
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(«) 



18.6. Demonstrate the validity of Eq. (18.29). 

18.7. The signal x(nT ) in a 4-band QMF bank has the triangular frequency spectrum shown in Fig. 18.10b. 
(ci) Sketch the frequency spectrums at the various nodes of the analysis section. 

(b) Repeat part (a) for the synthesis section. 

18.8. Time-division to frequency-division multiplex translation can be carried out by using the scheme depicted 

inFig. P18.8. Signals for A: = 0, 1. K — I are bandlimited such that X ck (ja>) = 0for|ro| > ai m . 

The lowpass filters shown are identical and each has a cutoff frequency co c = a> m . On the other hand, 
the highpass filters have distinct cutoff frequencies a> 0 , a>i, ..., cok -i ■ For correct operation, cu s > 2ai m , 
a>' > 2(a )io + Kcu m ), and oik > co/t-i + co m iork = 1,2. K — 1. 



cos co^^iT' 


Figure P18.8 


(a) Sketch the frequency spectrums at points A k B k , ... , F k , and G for the case where K = 3. 

( b ) Explain the role of the lowpass and highpass filters. 

18.9. Find the maximum number of channels in the scheme of Fig. P18.8 if co m — 4 kHz, qilo — 60 kHz, 
a> s = 8 kHz, and of = 216 kHz. 
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18.10. Frequency-division to time-division multiplex translation can be carried out by using the scheme depicted 
in Fig. P18.10 where the bandpass filters have passbands ci)k < u> < co k + a> m for k = 1,2, ... , K — 1 
and each of the lowpass filters has a cutoff frequency a> c > co m . Sketch the frequency spectrums of the 
signals at nodes A, B k , C k , D k , and E k for the case where K = 3. 


y(nT') 



Figure P18.10 


18.11. Chapter 9 describes the Fourier series method for the design of nonrecursive filters for the case where 
the filter length N is odd. Derive the impulse response for a lowpass filter with cutoff frequency a> c for 
the case where N is even. 

18.12. (a) Using the formula for the impulse response obtained in Prob. 18.11 along with the von Hann window 

design a halfband lowpass filter. Assume that N = 32 and a> s = 16 rad/s. 

( b ) Design a corresponding halfband highpass filter. 

(c) The filters in parts (a) and ( b ) are used in a QMF bank. Plot the amplitude response of the QMF 
bank. 

18.13. Redesign the filters in Prob. 18.12 using the Kaiser window with a = 3.0. Compare the results with 
those obtained using the von Hann window. 

18.14. Let the numerator polynomial of transfer function H A (s) in Example 18.2 be N(s). Demonstrate that 
N(s) and polynomials d A (s) and d B (s) in Eqs. (18.25) and (18.26) satisfy the relation 


Ud A (s)d B {-s) + d A {-s)d B (s )] = N(s) 


(see Sec. 17.5). 

18.15. (a) Redesign the filter in Example 18.2 using a fifth-order Butterworth approximation. 

(b) Demonstrate that the formula in Prob. 18.14 applies. 

(c) Two copies of the filter obtained will be used as the analysis and synthesis banks in a transmission 
system. Plot the overall group delay characteristic of the system. 

18.16. (a) Redesign the filter of Example 18.2 using a fifth-order Chebyshev approximation. 

(b) Determine the amplitude response of the lowpass filter by applying the bilinear transformation to 
the analog transfer function. 

(c) Determine the amplitude response of the lowpass filter by analyzing the lattice structure obtained 
(see Sec. 17.8). 
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18.17. 

18.18. 

18.19. 

18.20. 
18.21. 

18.22. 


18.23. 

18.24. 


18.25. 


18.26. 


The filter obtained in Prob. 18.16 is to be used both for the analysis and synthesis banks in the scheme 
of Fig. 18.9. Find the overall phase response of the system. 

(a) Design a Hilbert transformer of length 2V = 31 using the Kaiser window with a = 4.0, assuming a 
sampling frequency of 100 rad/s. 

(b) Repeat part (a) with N = 32. 

(c) Compare the results obtained in the two cases. 

Formulate the error function and obtain the necessary derivatives to enable the design of Hilbert trans¬ 
formers using the Remez exchange algorithm (say Algorithm 4 in Chap. 15). 

Demonstrate the validity of Eq. (18.44). 

The eigenvalues of an IV x IV matrix R„ are}.!, A 2 , ... , X N . Show that the eigenvalues of R„ = I n —2aK„ 
are given by A; = 1 — 2a A,-. 

The input and desired signals in an adaptive filter are given by 

x(n) = e - imn/N 

and 

d(n) = e - J( - an/N -+ m (n) 

respectively, where ni(n) is a white noise source with variance a 2 . 

(a) Calculate p„ and R„ for the case where a nonrecursive filter of length N = 2 is employed. 

( b ) Obtain the Wiener solution as well as the minimum MSE at the output. 

Show that the inequality in Eq. (18.62) is a sufficient condition for the stability of the LMS algorithm. 
Three variations of the standard LMS updating formula given in Eq. (18.61) are 

a„+i = a„ + 2 a sgn[e(n)]x„ 
a„+i = a„ + 2 ae{n) sgn(x„) 


and 


a„+i = a„ + 2a sgn[e(n)] sgn(x„) 


where 


sgn(x) = 



for x > 0 
for x < 0 


and 

sgn(x) = [sgn(xi) sgn(x 2 ) ... sgn(xjv)]' 

Constant 2a is usually chosen to be a power of two for the sake of computational efficiency. Discuss the 
effects of these simplifications on the gradient direction, convergence, and the residual error. 

Apply the LMS algorithm and each of the variations described in Prob. 18.24 for the identification of a 
system characterized by 

4 

H(z) = ^ z~ l 

i= 0 

using the initial coefficient vector ao = [0 0 0 0 0] r . Discuss the results obtained. 

If matrix R„ is approximated by a diagonal matrix whose diagonal elements are all equal to 

l|x„|| 2 = xjx„ 

the so-called normalized-LMS algorithm is obtained. 
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(a) Show that in this algorithm, the updating formula assumes the form 



where y is a small constant. 

(b) Explain the purpose of constant y. 

18.27. A transmission channel can be represented by the transfer function 


8 


H(z) = - 4)z- 


i= o 


Identify the channel by using first the LMS algorithm and then the normalized-LMS algorithm, and 
compare the results obtained. 

18.28. In real-time applications an estimate for R„, designated by R„, can be generated as 


= (1 - M)R„-i + MX„x,y 


where fi is a constant. On the other hand, if A, B, C, and D are matrices of appropriate dimensions, then 
they are interrelated in terms of the so-called matrix inversion lemma which states that 


(A + BCD) 1 = A 1 - A B(C 1 + DA B) DA 


Using the above formulas, derive a recursive formula for R n 1 . 

18.29. Algorithms using the gradient estimate given in Eq. (18.60) along with some estimate forR ( 7 * are referred 
to as LMS-Newton adaptation algorithms. 

(a) Construct such an algorithm using the estimate for R 7 1 obtained in Prob. 18.28. 

(b) Apply this algorithm to the system identification problem described in Prob. 18.25. 

18.30. A 2-D digital filter has the transfer function 


H(z 1 , z 2 ) = 


N{zu z 2 ) 


2Z1Z2 


D(zi,z 2 ) Z 1 Z 2 - 0.5zi - 0.5z 2 + 0.25 


Find its impulse response. The 2-D impulse function is defined as 



for n 1 = 112 = 0 
otherwise 


18.31. Repeat Prob. 18.30 if the transfer function is given by 


H(Zl,Z2) = 


A(Zi,Z 2 ) ZiZ 2 


D(zi,z 2 ) 2z!z 2 -1 


18.32. Plot the amplitude and phase response of the filter described in Prob. 18.30. 

18.33. Check the stability of the filters described in Probs. 18.30 and 18.31. 

18.34. A 2-D digital filter is characterized by the transfer function 
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where 


30 = 64(2! - l) 2 (Z2- l) 2 


and 


D(zi, Z 2 ) = 64z 2 z% - 32zizj + 48z 2 Z2 + 8z 2 + 8zf 
—24 jiz 2 — 4z\ + 6 Z 2 + 1 


Check its stability. 

18.35. A 2-D lowpass digital filter comprises two cascaded 1-D lowpass filters with passband edges co pi rad/s, 
stopband edges co ai rad/s, passband ripples A pi dB, and minimum stopband attenuations A ai rad/s for 
i = 1 and 2. Find the passband and stopband edges, passband ripple, and minimum stopband attenuation 
of the 2-D filter. 

18.36. Using the formulas obtained in Prob. 18.35 design a 2-D lowpass filter satisfying the following specifi¬ 
cations: 


w p i = 2.0 rad/s co P 2 = 3.0 rad/s 
u> a 1 = 2.4 rad/s a> a2 = 3.6 rad/s a> s 1 = a> s2 = 10 rad/s 

A p = 1.0dB A a > 40.0 dB 


APPENDIX 

A 


COMPLEX 

ANALYSIS 


A.l INTRODUCTION 

Digital signal processing (DSP) relies heavily on transform theory which, in turn, necessitates a fairly 
good understanding of complex analysis. In many universities, a course is available on this branch of 
mathematics, which is usually a prerequisite for courses on system theory, linear circuits, and DSP. 
Often no such course is offered and the instructor of DSP is obliged to deal with the relevant parts 
of complex analysis on the fly along with the standard DSP material. 

This appendix deals with the fundamentals of complex analysis and the basic objective is to 
enable an instructor to teach DSP at a university where a suitable prerequisite on complex analysis is 
not available. It can also serve as a quick reference to the basic principles. The topics to be discussed 
are selected on the basis of their relevance to DSP and the exposition is intended for the practitioner 
rather than the mathematician, i.e., principles, definitions, and theorems are presented with minimal 
rigor or proof. For a more mathematical treatment of the subject, the reader is referred to one of the 
standard textbooks on complex analysis [1-3]. 

The subjects considered include complex arithmetic, complex variables, differentiability, and 
analyticity of functions of a complex variable and their representation in terms of power series 
like the Laurent series. The appendix also includes brief biographical notes on some of the great 
mathematicians who developed the subject in the first place. Some of this material originates from 
the Biographies Index of the The MacTutor History of Mathematics Archive, School of Mathematics 
and Statistics, University of St. Andrews, Scotland [4], 
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A.2 COMPLEX NUMBERS 

The first reference to what we know today as complex numbers occurred during the fifteenth century. 
According to the record, the first person to carry out a calculation involving complex numbers was 
an Italian by the name of Cardano who was a qualified medical doctor turned mathematician by 
circumstances. 1 Cardano’s quote in Fn. 1 makes it quite clear that he did not grasp the enormity of 
what he had stumbled upon but another Italian by the name of Bombelli was able to put everything 
into perspective. 2 

The term complex number was introduced by Gauss who also paved the way for the devel¬ 
opment of complex numbers as an organized branch of mathematics. 3 The correct meaning of the 
term is of course composite number, not complicated number as perceived by students more or less 
everywhere. 

The roots of a quadratic equation 


are given by 


az 2 + bz + c = 0 


b *Jb 2 — 4 ac 

2 a 2 a 


(A.l) 


and if b 2 < 4 ac, we can write 


b \/b 2 — 4ac 
2 a 2a 

= _A±yzi y j ac ~ bl 

2 a 2 a 

= x + jy 

where x = —b/2a, y — \J (4 ac — b 2 )/(2a), and j — -J — \. The components of a complex number, 
x and y, are called the real and imaginary parts and can be represented by the notation 

x = Die z and y = 3m z 


l Girolano Cardano (Cardan in Latin) (1501-1576) is known for his work on the solution of the cubic and quartic 
equations. In his mathematical treatise Ars Magna, which also deals with his methods for the solution of cubic and quartic 
equations, Cardano states “Dismissing mental tortures, and multiplying 5 + V - 15 by 5 — V - 15, we obtain 25 — (—15). 
Therefore the product is 40, ... , and thus far does arithmetical subtlety go, of which this, the extreme, is, as I have said, so 
subtle that it is useless.” [4]. 

2 Rafael Bombelli (1525-1572) was the first person to work out the rules of complex arithmetic. He also published an 
algebra book that dealt with the state of the art on the subject and included his own contributions to complex arithmetic. The 
historical record shows that Bombelli had studied Cardano’s work and, no doubt, he was influenced quite substantially by it. 

3 Carl Friedrich Gauss (1777-1855) made many contributions to mathematics in the areas of differential equations, 
complex analysis, numerical analysis, and number theory. He also made important contributions to the theory of magnetism 
and, apparently, Gauss and Weber built a primitive telegraph device that could send messages over a distance of5000ft. 
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and j is called the imaginary unit [3]. 4 If coefficients a, b, and c are variables, then z in Eq. (A.l) 
becomes a complex variable, in general, which can assume real values. 

A complex number is deemed to be equal to zero if and only if its real and imaginary parts are 
both zero and two complex numbers z i and z 2 are deemed to be equal to one another if and only if 4 5 
the real and imaginary parts of zi are equal to the real and imaginary parts of z 2 , respectively, i.e., 

Zi = zi iff xi = x 2 and y\ = y 2 

A complex number can be depicted graphically in an {x, y} rectangular coordinate system 
such as that in Fig. A. 1. A coordinate system of this type is known as a complex plane or Argand 
diagram. 6 The representation of a complex number in terms of its real and imaginary parts is known 
as the Cartesian representation. 1 

From Fig. A.l, we note that 

x — r cos i jr and y = r sin i/r 

where 

/- y 

r = \z\ = x 2 + y 2 and = ar gz — tan -i — (A.2) 

x 


4 Mathematicians tend to use the symbol i for the imaginary unit. 

5 “If and only if” is often denoted as iff in mathematical language. 

6 Jean-Robert Argand (1768-1822) was an accountant and bookkeeper by profession but delved into mathematics in his 
spare time. He made other important contributions to mathematics in addition to his geometrical representations of complex 
numbers. For example, on the fundamental theorem of algebra that states that an nth-order polynomial has n roots and on 
combinations whereby r distinct objects are taken at a time from a set of s objects. 

1 After Rene Descartes (1596-1650), the inventor of analytic geometry. 
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are the magnitude (radius) and angle (or argument) of z, respectively. Therefore, 

z — x + jy — /‘(cos i jr + j sin i//) (A.3) 

Evidently, the radius and angle completely specify complex number z and the set {r. i//} is said to 
be its polar representation. 

A.2.1 Complex Arithmetic 

Complex numbers and variables can be added, subtracted, or multiplied according to the usual laws 
of algebra, such as, the commutative, associative, and distributive laws (see Sec. 4.4.1). Therefore, 
complex arithmetic need not present problems. 

A complex arithmetic operation that has no counterpart in real arithmetic is complex conjuga¬ 
tion. The complex conjugate (or simply conjugate) of z = x + jy is defined as 

z* = (x + jyT =x- jy 

Addition or subtraction of two complex numbers z\ — x\ + jy\ and z 2 — x 2 + j )’2 is carried 
out by adding or subtracting their respective real and imaginary parts, i.e., 

zi + Z 2 — Xi + jy 1 + X 2 + jyi = (xi + x 2 ) + j(y 1 + y 2 ) (A.4a) 

and 

zt - Z 2 = (xi + jy 1 ) - (x 2 + jyi ) = On - x 2 ) + j(yi - y 2 ) (A.4b) 

Multiplication is carried out by multiplying the two complex numbers term by term treating 
j just like a real number. Powers of j are simplified by noting that j 2 = —1, / 3 = —j, j 4 = 1, 
j 5 = j, and so on. Thus 

ziz 2 = (m + jy i)(x 2 + jy 2 ) = x\x 2 + j{x 2 yi + x\y 2 ) + j 2 yiy 2 

— (x 1 x 2 - yiy 2 ) + j(x 2 yi + xi y 2 ) (A.4c) 

Division can be carried out by multiplying the dividend and divisor by the conjugate of the divisor, 
i.e., 

zt 
Z2 


x 2 + y 2 


+ jyi _ (-^1 + jyi)(xi - jyi) 
+• jyi (x 2 + jyiXx 2 - jy 2 ) 
■2 + yiy 2 + j(x 2 y 1 - Xiy 2 ) 

9 . 9 


(A.4d) 


A.2.2 De Moivre’s Theorem 

If z\—x 1 + jyi — ri(cos j/\ + j sin fa) and z 2 — x 2 + jy 2 — r 2 (cos fa + j sin fa), it can be easily 
shown that 


Z1Z2 = nr 2 [cos(fa + fa) + j sin(fa + fa)) 


(A. 5 a) 
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and 


— = — [cos(i/ri - if 2 ) + j sin( x/j-i - f 2 )] (A.5b) 

Z 2 r 2 


The formula in Eq. (A.5a) can be readily extended to a product of n complex numbers as 


Z1Z2 ■■■Z„ = r,r 2 ■ ■ ■ r„ [cos(iAi + ^2 H- fn) + j sin(iAi + if 2 H - h tAJ] 


and if Zt = z 2 = • • • = z = r(cos 1 jr + j sin x/r), we get 

z" — [r(cosiA + j sini/f)]" = r n (cosmfr + j sin nif) (A.6) 


This relation is known as De Moivre’s theorem. 

If w" = z, then w — z' 3 " j s said to be an nth root of z. Using De Moivre’s relation in Eq. (A.6), 
it can be shown that a complex number has n nth roots, given by 


Wk — Z 1/n — r l/n {cos if + j sin if) 


l/n 


— fl/n 


if + 2lar if + 2krc 

cos-h j sin- 


(A.7) 


for k — 0,1, ... , n — 1. 


A.2.3 Euler’s Formula 


An alternative representation for a complex number z, referred to in this textbook as the exponential 
form, can be deduced from the following well-known series 


siniA = if 


if 2 

IT 


if 5 

5! 


1 1/ 2 if 4 

cos ib — 1-1-- • 

v 2! 4! 

if 3 2if 5 

tan if = if + — + — + ■ 

. if 2 if 2 

e^ = 1 + if H-1- 

2! 3! 


If we replace if by j if in Eq. (A. 10), we get 


if 2, 

4!~ 


f 5 

5!~ 


(A.8) 
(A.9) 
(A. 10) 
(A. 11 a) 


., j 2 if 2 j 2 if 2 j 4 if 4 

e 1 * = 1 + jif + ^ ^ + 


iV 5 

5! 


2 ! 


3! 


4! 


1A 2 JiA 3 . <A 4 , ,/iA 5 

= 1 + iif --- 

2! 3! 4! 5! 


if 2 if 4 

= 1 - — + -- 

1 2! 4! 


1 3! 5! 


(A. lib) 
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and from Eqs. (A.8), (A.9), and (A.l lb), we obtain the relation 


e— cos i [r + j sin f 


(A. 12) 


which is known as Eider’s formula. 


A.2.4 Exponential Form 

An arbitrary complex number z with polar representation {r, i fr} can be expressed as 


Z — r cos i jr + jr sin i// = r(cos i jr + j sin i Jr) 


(A. 13a) 


and from Euler’s formula in Eq. (A. 12), z can be expressed in terms of the exponential form 


Z = re** 


(A. 13b) 


where r — |z| and i jr — argz. 

Complex numbers like their real counterparts obey the law of exponents and thus the product 
of two complex numbers zi = r\e^' and z 2 = r 2 e ^ 2 can be obtained as 


Z 1 Z 2 = rxe’^'r^e^ 2 — r l r 2 e jl -' l ' 1+ ' l ' 2) 


(A. 14a) 


Hence 


\ziz 2 \ = nr 2 and arg(ziz 2 ) = fi + f 2 


(A. 14b) 


Division is just as easy. We can write 


Zi r\e JV ' ri 


Z 2 r 2 ej^ 2 r 2 




(A. 15a) 


and hence 


zi n zi 

— = — and arg — = — f 2 

Z 2 r 2 z 2 


(A. 15b) 


In general, an arbitrary ratio of products can be expressed as 


n hz m 
n Lz n 


ills 

— re JY 


(A. 16a) 


where 


Ylh \Zmi\ 

n,=l Uni I 


(A. 16b) 
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and 

M N 

if = ^2 arg Zmi ~ y^arg Zm (A. 16c) 

i= 1 i=l 

Similarly, the nth power of z can be expressed as 

z" = (re'^f = r n e’ n ^ = r''(cosni/r + j sinni/r) (A.17) 

which is an alternative form of De Moivre’s relation. Note that Euler’s formula in Eq. (A. 12) is 
actually De Moivre’s relation for the special case where r = 1 and n = 1. 


A.2.5 Vector Representation 

Complex numbers may be deemed to be two-dimensional vectors. Hence vector methodology can be 
used. Thus two complex numbers zi and zi can be added by using the parallelogram law illustrated 
in Fig. A.2a. Extending this principle, an arbitrary number of complex numbers can be added by 
aligning them end to end. For example, three complex numbers z\ = — 1 + jl, Zi = 2 + j 2, 
and Z 3 = 2 — j 1 can be added by using the construction illustrated in Fig. A.2 b. 

The sum of the magnitudes of N complex numbers is equal to or greater than the magnitude 
of their sum, i.e., 


N 




> 



(A. 18) 



Figure A.2 Vector representation of complex numbers: (a) Addition of two complex numbers using the 
parallelogram law, ( b ) addition of three complex numbers. 
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where the equal sign applies only if the complex numbers have the same angle. For example, if 
Zi = —1 + y'l, z 2 = 2 + j 2, and z 3 = 2 — y 1, we have 

3 

E kil = l(-l + j 1)1 + 1(2 + 72)| + |(2 - j 1)1 = V2 + Vs + V5 = 6.479 

i=l 


whereas 


3 


E 


Ci 


i =1 


= |(—1 + y 1) + (2 + y'2) + (2 — y 1)| = |3 + y2| =Vl3 = 3.606 


Clearly, 


3 


E^i 


> 


E^- 


This simple, yet important, inequality is illustrated in Fig. A.2 b. 


A.2.6 Spherical Representation 

It is sometimes convenient to represent the complex z plane in terms of the surface of a sphere 
of unit radius, as depicted in Fig. A.3 where the line passing through the north and south poles 
of the sphere passes through the origin of the complex z plane and is perpendicular to it. In this 



Figure A.3 Riemann sphere. 
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geometrical construction, which is known as a Riemann sphere , 8 given an arbitrary point P in the 
z plane, a line can be drawn joining point P with the north pole N of the sphere, as depicted in 
Fig. A.3, and the point of intersection of line PN with the surface of the sphere, namely, P', bares a 
one-to-one correspondence with point P. Evidently, each and every point in the complex z plane can 
be mapped onto a corresponding point on the surface of the sphere. The most significant feature of 
this stereographic projection is that any point situated at a very large distance from the origin will 
map in the neighborhood of the north pole and thus a point at infinity will map at the north pole. The 
Riemann sphere renders the abstract concept of infinity easier to understand. 

A.3 FUNCTIONS OF A COMPLEX VARIABLE 

A complex variable W may be a function of another complex variable z = x + jy. Such a relation 
can be expressed as 


W = F(z) 

and if U and V are the real and imaginary parts of IV, we have 

W - F(z) = U{x, y) + jV(x, y) 

Functions of a complex variable appear frequently in DSP and several types are available, e.g., 

• polynomials, 

• rational algebraic functions, 

• inverse algebraic functions, 

• exponential and logarithmic functions, 

• trigonometric and their inverse functions, 

• hyperbolic and their inverse functions, etc. 

These functions are generalizations of their real counterparts. 

A.3.1 Polynomials 

A polynomial in z assumes the form 


N 

P(z) — do + cqz + asZ~ + • • • + @nZ N — ^ ' cijz' 

7=0 

where z is a complex variable and coefficients a, for 0. I. N are typically real in DSP although 

they could be complex in certain applications. Integer N is the degree or order of the polynomial. 


8 Friedrich Bernhard Riemann (1826-1866) was born in Breselenz, Hanover (now in Germany). He took lessons from 
Gauss and Dirichlet. He contributed greatly to the theory of complex analysis and built upon the theories of Cauchy. He 
produced original work on conformal transformations (see Sec. A.9) and introduced topological methods into complex 
analysis. 
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Values of z that yield P(z.) = 0 are said to be the roots of the polynomial and from the so-called 
fundamental theorem of algebra, an Nth-order polynomial has N roots. If the coefficients are real, 
the roots are either real or occur in complex-conjugate pairs. 


A.3.2 Inverse Algebraic Functions 

Given a function 


5 = F(z) 

where s and z are both complex variables, a new function 

z = G(s) 

can sometimes be obtained. Such a function is said to be the inverse of F(z) and can be expressed as 

z = G(s) — F _1 {^} 


For example, if 


then 


z + 1 


z=F~ l {s} 


s + 1 


s — 1 


A.3.3 Trigonometric Functions and Their Inverses 

On replacing f in Eqs. (A.8)-(A. 10) first by z and then by — z, we can readily conclude that the sine 
and tangent functions are odd functions and the cosine is an even function of z, i.e., 

sin(—z) = — sinz cos(—z) = cosz tan(—z) = — tanz (A. 19) 

Now on replacing i p first by z and then by —z in eJ* in Eq. (A. 1 lb), the basic trigonometric functions 
of a complex variable z can be obtained as 

—(e’ z - e~ jz ) (A.20a) 

2 j 

X -{e jz +e~ jz ) (A.20b) 

sin z e* z — e~^ z 
cosz j{e> z + e~l z ) 


sinz = 

cosz = 

tanz = 


(A.20c) 
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The following identities follow their real counterparts: 


sin(;i ± zi) = 

sin ;i cos ; 2 ± cos zi sin ; 2 

(A.21 a) 

cos (;j ± zi) — 

cos;! cos; 2 =F sin;i sin; 2 

(A.21b) 

tan (;j ± zi) — 

tan;i ± tan; 2 

(A.21c) 

1 =F tan;i tan; 2 

sin 2 ; + cos 2 ; = 

1 

(A.2 Id) 


The standard inverse trigonometric functions are given by 

sin -1 z = In ^ jz + \J 1 — z 2 j (A.22a) 

cos -1 z— ~ In + \fz} — T) (A.22b) 

tan -1 z = — In | ) (A.22c) 

V \l-jz) 

where In z = log c z is the natural logarithm of z. 


A.3.4 Hyperbolic Functions and Their Inverses 

Like their trigonometric counterparts, the hyperbolic sine and tangent are odd functions and the 
hyperbolic cosine is an even function of z, i.e., 

sinh(— z) = — sinh; cosh(— z) = cosh; tanh(—;) = — tanhz (A.23) 


and by analogy with Eqns. (A.20) and (A.21), we have 


and 


sinh; 

cosh; 

tanh; 


-(e’-e z ) = ~j sin j; 
~{e z + e~ z ) — cos jz 


sinh; 

cosh; 


e z — e z 
e z + e~ z 


~j tan jz 


sinh(;i ± ; 2 ) 
cosh (zi ± zi) 

tanh(;i ± zi) 


sinh;i cosh; 2 ± cosh;i sinh; 2 
cosh;] cosh; 2 ± sinh;i sinh; 2 
tanh;i ± tanh; 2 
1 ± tanh;i tanh; 2 


cosh 2 ; — sinh 2 ; = 1 


(A.24a) 
(A. 24b) 
(A.24c) 


(A.25a) 
(A.25b) 

(A.25c) 

(A.25d) 
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On the other hand, the inverse hyperbolic functions are given by 


sinh 1 

1 z = In 

(z + \/ z 2 + l) 

(A.26a) 

cosh -1 

1 Z = In 

(z ± \/z 2 — ij 

(A.26b) 


, 1 



tanh 1 

z = - 
2 

ln 1-J 

(A.26c) 


A.3.5 Multi-Valued Functions 

In a functional relation of the form 

w = F(z) 

Z can assume arbitrary complex values in the z plane and for each value of z there is one or more 
values of w that can be plotted in the w plane. We can say that the relation maps points of the z plane 
onto points of the w plane. 

Consider the functional relation 


w = z 1/2 (A.27) 

and let z = re^ be an arbitrary complex number which can be drawn as shown in Fig. A.4a. Solving 
Eq. (A.27) for w , we get 


w\ = u\ + jv i = r 1/2 e^ 2 

and thus point z in Fig. A.4a maps onto point w \ in Fig. AAb. Since angles \j/ and i// + 2zr are 
essentially one and the same angle, complex number z can also be written as 

z = re M+2n) 



(«) t b) 

Figure A.4 Multi-valued function w = z 1/2 . 
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and if we solve Eq. (A.27) again for w, we get 


w 2 = u 2 + jv 2 = r lll e^ l2+n 

Thus, one and the same point in the z plane maps onto two points in the w plane, which means that 
for each value of z, function w assumes two distinct values, as depicted in Fig. A.4/;. Such a function 
is, in effect, a two-valued function. Generalizing this principle, a function w = F(z) that can assume 
more than one value in the w plane for each value of z is said to be a multi-valued function. 

Many of the theorems of complex analysis are applicable only to single-valued functions and 
it would appear that such theorems would not be applicable to multi-valued functions such as the one 
in Eq. (A.27). However, through a geometrical interpretation due to Riemann it is possible to treat 
multi-valued functions as if they were single-valued. In this interpretation, the z plane is deemed to 
be made up of overlapping sheets and points like z — re^ and z! — re^ +2n are considered to be 
unique points on different overlapping sheets. To illustrate this idea, let us reconsider the function 




(b) 


Figure A.5 Multi-valued function w = z 1/2 . 
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in Eq. (A.27). By imagining the z plane to be made of two overlapping sheets such that the bottom 
sheet is joined to the top sheet along the positive real axis through a four-way seam, as depicted 
in Fig. A.5a, then points z — re^ and z' — re^ +27T can be considered to be distinct thereby 
causing the mapping to become one-to-one, i.e., each and every point in the z plane corresponds to 
a unique point in the w plane, as depicted in Fig. A.5 b. Under these circumstances, the function in 
Eq. (A.27) can be considered as if it were single-valued and, consequently, any theorems that apply 
to single-valued functions also apply to the function in Eq. (A.27). 

Surfaces such as that in Fig. A.5a are said to be Riemann surfaces after their inventor. The 
four-way seam in Fig. A.5a (solid line), which extends from x — 0 to infinity, is commonly referred 
to as a branch cut and the origin of the Riemann surface is called a branch point. 

Another example of a multi-valued function is the n root of z, that is. 


As in the previous example, the origin of the z plane is a branch point and the positive real axis is a 
branch cut. The Riemann surface comprises n sheets in this case. 

In certain multi-valued functions, the Riemann surface has an infinite number of sheets and 
such functions are, therefore, said to be infinite-valued. Consider the natural logarithm of z given by 

w — Ins (A.28) 


where 


For any integer k, the identity 1 = (cos 2Aur + j sin 2kn) = e' 2kn holds and thus we can write 

z = re j * • 1 = re j * ■ e j2kn = re M+2kn) (A.29) 

Hence Eqs. (A.28) and (A.29) give 

w = lnz = \n(re M+2klt) ) = lnr + \ ne M+2klt) 

= lnr + j(\jj + 2kn) 

We conclude, therefore, the natural logarithm of z is an infinite-valued function. 

Just like the other multi-valued functions considered, the natural logarithm of z can also be 
treated as if it were a single-valued function by representing the z plane in terms of a Riemann surface 
comprising an infinite number of sheets connected in the form of a spiral as that illustrated in Fig. A.6. 
The distance between overlapping sheets is, of course, zero, in theory. The range — it < i// < tx is 
said to be the principal angle of z,. 

A.3.6 Periodic Functions 

In DSP, certain functions of a complex variable such as the frequency spectrum of a signal or the 
frequency response of a discrete-time system are periodic. 

A function H(e ■ 7 ® r ) is a periodic function of a> with period a> s , if 

H ( e j(<o+kco s )T ) _ H(e juT^ 


(A.30) 
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Figure A.6 Riemann surface of a periodic function. 


As in the case of multi-valued functions, the nature of periodic functions can be elucidated by 
representing the z plane in terms of a Riemann surface. For the periodic function of Eq. (A.30), the 
Riemann surface would assume the form of a spiral ramp such as those found in car parkades, as 
illustrated in Fig. A.6. The parkade would have an infinite number of floors above as well as below 
ground level but the height between floors would be zero. For a given &>, points ... e^ (ro ~ a> ’\ e J "‘, 
e j(o>+o> s ) would map at the same coordinates but on distinct sheets one above the other in Fig. A.6. 

Note that there is an important difference between the Riemann surface of the periodic function 
in Eq. (A.30) and that of the multi-valued function in Eq. (A.27). The latter has a branch cut on the 
positive real axis as depicted in Fig. A.5a but the former does not. 


A.3.7 Rational Algebraic Functions 

A rational algebraic function is a ratio of polynomials of the form 


mz) = 


N(z ) 

O(z) 


EjU 

Ef=0 b iZ‘ 


(A.31) 


Rational functions arise frequently both in analog and digital filters in the form of continuous- or 
discrete-time transfer functions. The frequency response of these biters is determined by evaluating 
the transfer function with respect to some domain of a complex plane, for example, the frequency 
response of a digital biter is obtained by letting z = e 7 "' 7 in the discrete-time transfer function H(z), 
that is, H(e 7 “ r ), whereas for an analog biter, we evaluate the continuous-time transfer function on 
the ja> axis. The amplitude and phase responses of a digital biter are simply the magnitude and angle 
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of the frequency response (see Chap. 5) and can be obtained as 

M(co) = \H(e j(oT )\ and 0(<w) = arg H(e jaT ) 


and as in Eqs. (A.16a)-(A.16c), Eq. (A.31) gives 


M(w) = 


N(e jalT ) 
D(ei mT ) 


f [me N(e ja,T )] 2 + [3m N(e jaT )] 2 
\ [me £>(e> r )] 2 + [3m D(ei‘ oT )] 2 


1/2 


and 


(A.32a) 


(A.32b) 


9(co) = arg H(e Ja,T ) = arg N(e i<oT ) - arg D(e ja>T ) 

3m N(e^ T ) 3m D(e^ a>T ) 

= tan -—-tan -—— 

me N(e^ T ) me D(e^ T ) 


(A.32c) 


The determination of angle 6(a>) needs special attention because the inverse tangent is a multi¬ 
valued function. To start with, one should not divide each imaginary part by the corresponding real 
part before calculating the inverse tangents, otherwise, an erroneous result may be obtained through 
loss of information. If, for example, the real and imaginary parts are both negative, then the inverse 
tangent would give an angle in the third quadrant but if the real part were divided by the imaginary part 
to start with, a positive number would be obtained, which would give an angle in the first quadrant. 9 

Another issue to be resolved has to do with the fact that computers in general will evaluate 9(a)) 
in the range — n < 9(co) < n although the phase response of a digital filter can be smaller than — n 
or larger than it. This problem can be resolved on the basis of the continuity of the phase response. 
If the phase angle changes in an anticlockwise direction from 7r — $i to 7r + $ 2 , where 0 < < tt 

and 0 < 02 < tc , the new phase angle will be evaluated as —n + Thus if the complex value of 
the frequency response moves from the second to the third quadrant of the z plane, an angle of 2ix 
must be added to the computed phase response in order to get the correct phase angle. On the other 
hand, if the phase angle changes in a clockwise direction from —(tc — $i) to —(jt + #2), the phase 
angle would be computed as 7r — t> 2 , i.e., if the complex value of the frequency response moves 
from the third to the second quadrant, an angle of lit must be subtracted from the computed phase 
angle. In other words, if the complex value of the frequency response crosses the negative real axis 
in an anticlockwise or clockwise direction an angle of lit must be added to or subtracted from the 
computed value, as appropriate. 


A.4 BASIC PRINCIPLES OF COMPLEX ANALYSIS 

Below some of the key basic principles of complex analysis are highlighted. 


A.4.1 Limit 

A function F(z) is said to have a limit Fq as z approaches if (o) F(z) is defined in a neighborhood 
of /Q (except perhaps at point -q) and (b) for every positive real number e there exists a positive real 


9 III the MATLAB environment, one should use the four-quadrant inverse tangent function atan2. 
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number 8 such that | F(z) — Fq| < e for all values of z ^ Zo in the disk \z — Zol < <5. Limit Fq can 
be expressed as 


F 0 = lim F(z) 

z->z 0 

A function F(z) is said to be continuous at point z = ~ (l if F(zq) is defined and is given by 

F(zo) = lim F(z) = Fq 

Z-^-Ztt 

Extending this concept somewhat, a continuous function is one that is continuous at all the points 
where it is defined. 


A.4.2 Differentiability 

The concept of limit leads readily to the definition of differentiability of a complex function. 


Definition A.l Differentiability A function F(z ) is said to be differentiable at a point z — Zo if 
the limit 


F\zo) 


F(z 0 + A z) - F(zo) 

lim - 

A :—>0 Az 


(A.33) 


exists. This limit is called the derivative of F(z) at point z = Zq- A 


If we let Zq + Az = z in Eq. (A.33), we obtain 


F'(zo) = lim 

Z—'>Z0 


F(z) - F(zp) 
z - zo 


(A.34) 


Hence the derivative exists if and only if the quotient in Eq. (A.34) approaches a unique value 
independent of the path z may take to approach zq. 


A.4.3 Analyticity 

A closely related property to differentiability is the analyticity of a complex function. 

Definition A.2 Analyticity A function F(z ) is said to be analytic at a point z — zo if it is defined 
and has a derivative at every point in some neighborhood ofzo■ A function F(z) is said to be analytic 
(also referred to as holomorphic or regular) in a domain D if it is analytic at every point in D. ▲ 

Differentiability is a crucial requirement in practice and, consequently, the importance of 
analyticity cannot be overstated. Indeed, complex analysis is concerned exclusively with analytic 
functions. Two important equations that pertain to the analyticity of a function are the Cauchy- 
Riemann equations which are given by 


dU _ dV 
dx 3 y 


and 


3 U 
dy 


8V 

dx 
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These equations are necessary and sufficient for a function to be analytic; that is, if the real and 
imaginary parts of a function satisfy the Cauchy-Riemann equations in domain D, then the function 
is analytic in D, and conversely. 10 

A.4.4 Zeros 

If a function F(z) is analytic in a domain D and is zero at a point zo, then the function is said to have 
a zero at zo- If in addition to F(z), the derivatives 

dF(z) d*- n ~ l) F(z) 

dz dz n ~ l 


are also zero and 


d n F(z) 

dz n 


^0 


at z — zo 


then the function is said to have a zero of order n at point z o- A function F(z) that has an nth -order 
zero can be expressed as 


F(z) = (z-zoTG(z) (A.35) 

where G(zo) ^ 0. A first-order zero is usually referred to as a simple zero. 

An analytic function F(z) is said to have an nth-order zero at infinity if F( 1 /z) has an nth-order 
zero at z = 0. 

A.4.5 Singularities 

A point Zoc at which a function F(z.) ceases to be analytic is referred to as a singular point of the 
function; alternatively, the function is said to have a singularity at z = Zoo- 
There are several types of singularities, e.g., 

• poles, 

• essential singularities, 

• branch points, etc. 

(see Ref. [1]) but the most significant ones for DSP are the poles; the other types show up only rarely. 
POLES. A function 


F(z) = 


G(z) 

(z - Zoo) n 


10 Augustin-Louis Cauchy (1789-1857) grew up in Paris during the difficult times of the French revolution. In 1810 
Cauchy took up his first job to work on port facilities for Napoleon’s English invasion fleet. Laplace and Lagrange were 
family friends, Legendre was an acquaintance, and Ampere was his tutor. 
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is said to have an nth-order pole at z = Zoo if 

lim (z — Zoo) n F(z) = G(zoo) 7 ^ 0 (A.36) 

Z ^Zoo 

As in the case of zeros, a pole is said to be simple if n = 1 . A function F(z) has a pole at infinity if 
F( l/z) has a pole at the origin. 

Some functions with poles are as follows: 

z — 1 

Fa{z) — - has a simple zero at z = 1 

z + 1 

z 2 

Fb(z ) = —- has a second-order zero at z = 0 

z 2 - 2z + 1 

Fc(z) = (z 2 + 9 ) 3 has a third-order zero at z = ±7 3 


1 

Fd(z) = . has a hfth-order zero at z = 00 

z 5 

BRANCH POINTS. Branch points occur in multi-valued functions. As was shown in Sec. A.3.5, 
w = z 1 ' /2 is a multi-valued function with a branch point at the origin of the z plane. Since 

dw 1 
dz 2 z xjl 

the derivative of w does not exist at z = 0 and, therefore, w has a singularity at the origin. 

ESSENTIAL SINGULARITIES. Essential singularities typically arise in functions that can be ex¬ 
pressed in terms of infinite series (see Laurent Theorem in Sec. A. 6 ). The following two functions 
have essential singularities at the origin of the z plane: 


F£b) = ,'/= = 1 + I + _L + _i_ + ... 


Ill 2 

Ff {z)- tan- —-+^3+^ + " 


ISOLATED AND NONISOLATED SINGULARITIES. Singularities can also be classified as isolated 
or nonisolated. An isolated singularity has a neighborhood that contains no other singular points. If 
no such neighborhood can be found, the singularity is said to be nonisolated. 

Poles are always isolated singularities. Essential singularities can be either isolated or noniso¬ 
lated. The function 

F lW = e « = 1 + l + _i_ + _L + ... 
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has an isolated essential singularity at the origin, since F(z.) does not have a singularity at z — 0 + e. 
On the other hand, function Fp(z) — tan I /z has a nonisolated singularity at z = 0 since the 
function is not analytic at an infinite number of points clustered in any neighborhood of z — 0. To 
demonstrate this fact, we note that the tangent function assumes an infinite value if its argument 
is ±7r/2 , ±3tt/2, ±5tt/ 2, .... Hence Fp(z ) is not analytic at 

2 2 2 

z = ± —> ± —, , ••• 

Tt 3 tt 5tt 

and, therefore, it is not analytic at an infinite number of points in the range —e < Die z < e for any 
positive 6. 


A.4.6 Zero-Pole Plots 

An arbitrary rational function can be expressed as 


F(z) = 


N(z) 

D(z) 


Z N + Eill b iZ N - 


(A.37a) 


and by finding the roots of the numerator and denominator polynomials N(z.) and D(z), F(z.) can be 
put in the form 


F(z) = 


n(z) _ H n L(z - z,r 

d(z ) °nf=i (z- Pi r 


(A.37b) 


where zi, Z 2 , ■ ■ ■ , Zz an d p 1 , pz, ■ ■ ■ , Pp are the zeros and poles of F(z), respectively, m, and «,■ 
are the orders of the z'th zero and ;th pole, respectively, and II 0 is a multiplier constant. The order of 
the numerator and denominator polynomials in F(z) are given by 

z p 

m = E nij and N = y^ra,- (A.37c) 

;=1 ;=1 


respectively. 

A plot of the zeros and poles of a rational function is said to be the zero-pole plot of the 
function. Such a plot along with the corresponding orders of the zeros and poles and the multiplier 
constant Hq completely represent the function. 

As an example, the function 


F(z) = 


(z 2 - 4) 

(z 2 - l)(z 2 + 4) 


(A.38a) 


can be expressed as 


F(z) = 


(z ~ 2)(z + 2) 

(z-D(z+l)(z-j2)(z + j2) 


(A.38b) 


and by using small circles and crosses for the zeros and poles, respectively, the zero-pole plot of 
Fig. A.7 can be constructed for F{z). 
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Figure A.7 Zero-pole plot. 

Functions of z that are analytic in the entire finite z plane, e.g., a polynomial in z such as 
F(z) — 1 + 2z + 3z 2 + z 4 , are called entire functions. Functions whose singularities in the finite z 
plane (i.e., for all z ^ oo) are poles, e.g., rational functions, are called meromorphic functions. 


A.5 SERIES 

Given a sequence of numbers Wq, u>i , ... , w, ... , which may be real or complex, the infinite series 

OO 

Y Wi (A.39) 

!= 0 

can be formed where Wj is said to be the ith term of the series. 

The sum 

n 

S n = ^2 Wi 

i=0 

is said to be the nth partial sum and 

OO 

R n = Wi 

i=n +1 

is said to be the nth remainder of the series. 

If 

S — lint S, 

n—>oo 

and a number N can be found such that 



| S — S„ | < e for all n > N 


(A.40) 


then the series converges and S is said to be the limit of the sum. 
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Series arise quite frequently in DSP. Some of their properties can be summarized in terms of 
a number of theorems, as follows [1], 

Theorem A.l If a series wq + w\ + • • ■ + + • • • converges then 


lim wjy —► 0 A (A.41) 

N—>oo 

Theorem A.l is stating, in effect, that a series diverges if Eq. (A.41) is not satisfied. 

A series wo + w\ + ■ ■ ■ + u>n + ■ ■ ■ is said to be absolutely convergent if the series 

OO 

E i w 'i 

i =0 

converges. 

Theorem A.2 Absolute Convergence If a series wo + w\ + • • ■ + + • • • is absolutely 

convergent, i.e., \ | + | w\ | + ••• + | w N j + • • • is finite, then the series converges. A 

Theorem A.2 follows from the fact that sum of the magnitudes of a series of complex numbers 
is equal to or greater than the magnitude of the sum of the same series of complex numbers (see 
Eq. (A.18)). 

A number of tests that can be used to check the convergence of a series are available such as 
the ratio and root tests. The ratio test can be stated in terms of the following theorem. 

Theorem A.3 Ratio Test If u\ f 0 for i — 0, 1, 2,_ and in addition 


Wn +1 
W n 


< q 


for i > N 


where q is a fixed number less than 1, then the series in Eq. (A.39) converges. On the other 
hand, if 


w„+i 

w,, 


> 1 


for i > N 


then the series diverges. A 

If u>i is replaced by c,z' in the series of Eq. (A.39) where z is a complex variable, a series of 
the form 


OO 


E 


CiZ 


i=0 


(A.42) 


is obtained, which is usually referred to as a power series. The sum of a power series and its nth 
partial sum are given by 


S(z) = Y CiZ ‘ 
1=0 


S„(z) = Y CiZ ' 

1=0 


and 
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respectively. If for any given c > 0, a number N can be found such that 

| S(z) - S n (z)\ < e for all n > N (A.43) 

where N may depend on e and ", then the power series converges. If a number N can be found that 
is independent of z, then the power series is said to converge uniformly. 

A power series may converge for some values of z and diverge for others. Regions of the 
Z plane over which a power series converges or diverges are said to be regions of convergence or 
divergence. 

If Cj = 1, the series in Eq. (A.42) assumes the form 


;=o 


Such a series is said to be a geometric series with a common ratio 


W;v + 1 

-= z 

W N 


In order to check the convergence of a geometric series, let 

N 

S = I 

;=0 

be the sum of a finite geometric series. We can write 


S-zS = (l-z)S 

= (1 + z + z 2 H-1- z N ) - z(l + z + z 2 H-b z N ) 

_ l _ fN+l) 


(A.44) 


(A.45) 


(A.46a) 


and hence 


S = 


l - z (N+l) 


1 - z 


(A.46b) 


Now if |z| < 1, say z = re^ e with r < 1, we have 


V z' = lim S 

N—>-oc 


i=0 


= lim 

N—>oo 


1 _ r (N+i) e je(N+i) 


1 

1 - z 


1 — ret 6 

since lim ; \ ^oc r w+1) —*■ 0 for r < 1. Therefore, the series converges for \z\ < 1. 
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For |z| > 1, say z = re with r > 1, we can now write 


lim S = lim r N e j0N —*■ oo 

N—>oo N—>oo * ^ 


i=0 


since lim^^oo r (Ar+1) —>• oo for r > 1. 

For |z| = 1, say z = e * 6 , the Ath term of the series assumes the form 

w N = e jNe = cos NO + j sin NO 


and since 


lim Wn ^ 0 

N—>oo 

then on the basis of Theorem A.l, we conclude that the series does not converge for |z| = 1. 

If a power series converges for values of z such that kl > p and diverges for |z| < p or the 
other way around, then the circle |z| = p is said to be the circle of convergence and p is the radius 
of convergence. For the geometric infinite series of Eq. (A.44), p = 1. 

A power series that occurs frequently in DSP is the binomial series which is given by 


{\ + b) r = 1 + 




(A.47) 


where 


j _ r(r — 1) • • • (r — 5 + 1) 


(A.48) 


and 0! = 1. For a positive integer r, the coefficients of the polynomial obtained are the entries of the 
(r + I)th row in the so-called Pascal triangle, which is as follows: 


1 

1 1 
1 2 1 

13 3 1 

1 4 6 4 1 

1 5 10 10 5 1 


e.g., for /■ = 3, we have (1 + b) 3 — 1 + 3b + 3 b 2 + b 3 . 
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A.6 LAURENT THEOREM 

One of the most important theorems in complex analysis is the Laurent theorem 11 which defines the 
Laurent series and deals with some of its properties. The Laurent series happens to be particularly 
important for DSP because, as shown in Chap. 3, the z transform is actually a Laurent series. 

Theorem A.4 Laurent Theorem (a) If F(z) is an analytic and single-valued function 12 on 
two concentric circles Ci and Cf with center a and in the annulus between them, as illustrated 
in Fig. A.8a, then it can be represented by the Laurent series 


F(z)= a n iz-ar n (A.49) 

n=—o o 

where 

a n = <f F(z)(z - a)”- 1 dz (A.50) 

2ttj J r 

The contour of integration T is a closed contour in the counterclockwise sense lying in the 
annulus between circles C\ and Ci and encircling the inner circle. 

(b) The Laurent series converges and represents F(z) in the open annulus obtained by 
continuously increasing the radius of C 2 and decreasing the radius of Ci until each of Ci 
and C 2 reaches a point where F{z) is singular, as depicted in Fig. A.8b. 

(c) A function F(z ) can have several, possibly many, annuli of convergence about a 
given point z — a, as shown in Fig. A.8c, and for each one a Laurent series can be obtained. 

(d) The Laurent series for a given annulus of convergence is unique. A 

The Laurent series can expressed as a sum of two series as 


OO 

F(z) = ^2 a n(z - a)~ n 

n=—o o 

0 00 

= ^2 a n(z - a)~" + ^2 a n(z - a)~" 
n=—o o n= 1 


11 Pierre Laurent (1813-1854) was born in Paris. He served in the engineering corps and spent six years directing 
the operations for the enlargement of the port at Le Havre (north-west of Paris). Laurent submitted his famous work on the 
Laurent series for the Grand Prize of 1842 of the Academie des Sciences but, unfortunately, he missed the official deadline. 
Cauchy, who was 24 years his senior, reported on the work and argued that the submission should be approved but it was not 
accepted. 

12 The Laurent theorem is also applicable to multi-valued functions provided that the z plane is treated as a Riemann 
surface (see Sec. A.3.5). 
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Figure A.8 

and if we let 


Laurent theorem. 

a n — b_„ and then replace n by —n in the first part, we obtain 

0 oo 


F (z) = ^2 b -»( z ~ fl ) 


£ 

n=\ 


(z - a) n 


= ^2b„(z-a) n + ^ 


Cn 

(z - a) n 


(A.51) 


The left- and right-hand parts of the Laurent series are known as the analytic and principal parts , 
respectively, and if the Laurent series has a principal part, then function F(z) has a singularity at 
Z = a. The type of singularity depends on the number of terms in the principal part as follows: 


• If the principal part has just one term, i.e., c i ^ 0 and c n — 0 for n > 1, then F(z) has a simple 
pole at z = a. 

• If the principal part has just m terms, i.e., c m ^ 0 and c n = 0 for n > m, then F(z) has an 
/nth-order pole at z = a. 

• If the principal part has an infinite number of terms, then F(z) has an essential singularity at 
Z — a. 
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Coefficient c\, that is, the first coefficient in the principal part, is of crucial importance in 
complex analysis and for this reason it has a special name. It is called the residue of function F(z.) at 
the singular point z = a and it will surface again in the next section in the so-called residue theorem. 

Some typical Laurent series are as follows: 

, 1 

Fa(z) = Z + 2z + 1 H-has a simple pole at z = 3 

z - 3 

1 2 3 

Fb(z) = Z 2 + 2z + 1 H-— + --—r + --—r has a third-order pole at z = 1 

u - i) (z -1 y (z - ip 

Fc(z) — 4 z 4 + 3z 3 + 2z 2 + z + 1 is analytic in the finite z plane 

1 

F d (z.) = I H—- has a seventh-order pole at z = 0 

v 

1/7 11 1 

F e (z) — e 1 =1-| -1-- H-— + • • • has an isolated essential singularity at z = 0 

z 2!z 2 3!z J 

111 2 

Fp (z) = tan - = —|-- H-- + • • • has an nonisolated essential singularity at z = 0 

z z 3z 3 15z 5 

According to part (c) of the Laurent theorem, a function F(z) can have one and only one 
Laurent series in a given annulus of convergence. However, a function can have several annuli of 
convergence and each will have its unique Laurent series. For example, function F(z) in Eq. (A.38b) 
has three annuli of convergence about point z = a, as depicted in Fig. A. 9a and b, where the radius 
of the inner circle in annulus I can be infinitesimally small and that of the radius of the outer circle 
in annulus III can be infinitely large. 

If c„ = 0 for all n > 1, the Laurent series assumes the form 


F(z) = Y, K( z ~ «)" 

n =0 


(A.52a) 


and if we let z — a = h or z = a + h , we get 


OO 

F(a + h) = ^2h n h n 

n =0 


(A.52b) 


Straightforward analysis will show that 


b 0 = F(a) 


and 


1 d"F(a + h) 
nl dh" 


h=o 


(A.52c) 
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Figure A.9 Annuli of convergence for function F(z) in Eq. (A.38&) for point z = a. 


and from Eqs. (A.52b) and (A.52c), we get 


oo 

F(a + h) — F(a ) + ^ 

n= 1 


h" d n F(ci + h) 
n ! dh" 


h =0 


(A.52d) 
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If z is assumed to be a real variable and a = x, Eq. (A.52d) assumes the form of the familiar Taylor 
series of a function of a real variable, namely, 


h" d n F(x) 

F{x + h) = Fix) + V — —y (A.52e) 

n ! dh n 

n= 1 

In effect, Eq. (A.52a) is the Taylor series for F(z) about point z = a. If, in addition, a — 0, the 
Taylor series about the origin of the z plane is obtained, i.e., 

OO 

F(z)=Y J b »z n (A.52f) 

n =0 


which is commonly referred to as the Maclaurin series of F(z). 


A.7 RESIDUE THEOREM 

A Laurent series for a function F(z) can be obtained by evaluating coefficients a„ for — oo < n < oo 
using the contour integral in Eq. (A.50). This appears to be a formidable task but for the class of 
meromorphic functions, the evaluation of the contour integral in Eq. (A.50) becomes a matter of 
simple algebra by virtue of the residue theorem. 

Theorem A.5 Residue Theorem If G(z) is an analytic function on a simple contour T and 
inside T, except for a finite number of singular points Pi,P 2 , • • • , Pp, then 

If P 

— f Giz)dz = Y' G(z) (A.53) 

2 A/ Jr z ^ Pi 


where the integral is taken in the counterclockwise sense and ‘D\es z ^ Pi G{z) is the residue of 
G(z) at singular point z — Pi- ▲ 

For a rational function of the form 


G(z) = 


N(Z) = H U ‘= l(Z ~ ZiT ‘ 

°nf=i (z-Pi) n ‘ 


(A.54) 


the residue at a pole z — Pi of order n, is given by the general formula 


Kes G{z) = 1 — lim ~ a)"‘G(z)] 

z=Pi (n, — 1)! z-^pt dz ‘ 


(A.55) 


For a simple pole, i.e., if «, = 1, we differentiate zero times and since 0!=1 by definition, we 
get the simplified formula 


mes G(z) = lim [(z - p,)G(z)] 

z=Pi z-rpi 



920 DIGITAL SIGNAL PROCESSING 


A.8 ANALYTIC CONTINUATION 

On many occasions in the design of analog and digital filters, a function of a complex variable z, say, 
F(z), is known to be analytic in some specified region of the z plane, say, inside circle C\ shown in 
Fig. A. 10, but is otherwise unknown. Such a function can be represented by a Taylor series of the 
form 


>51 = YMz ~ " 

n= 0 


(A.56a) 


Series Si represents function F(z ) everywhere inside circle Ci and hence the function value 
and its derivatives at point a can be determined. If function F(z) is analytic in circle C 2 , then a new 
Taylor series can obtained for F(z) given by 


S 2 = y^5„(z - a) " 

n= 0 


(A.56b) 


where coefficients b n can be obtained from the derivatives of F(z) at point a using Eq. (A.56a). Series 
S 2 can now be used to obtain the function value and its derivatives at point a. If F(z) is analytic in 
circle C 3 , a new Taylor series can obtained for F(z) given by 

OO 

S 3 = Y^n(z-a)- n (A.56c) 

n=0 


where coefficients b can be determined from the derivatives of F(z.) at point a. Series S 3 represents 
F(z) everywhere in circle C 3 . Through this process, the domain of validity of F(z) can be extended 
to include the areas of circles C 2 and C 3 . Proceeding in the same way, the domain of validity of F(z.) 



Figure A.10 Analytic continuation. 
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can be extended to cover all the areas of the z plane over which the function is analytic. This process 
is known as analytic continuation [5] and it has a number of applications in DSP. 

The frequency response of a stable analog filter, H/fjoo ), is analytic on the jco axis of the s 
plane. Through analytic continuation, the domain of the function can be extended to points off the 
imaginary axis and hence jco can be replaced by s = a + jco. The function obtained, namely, H A (s ) 
is the transfer function of the analog filter and represents the filter at all points where Ha(s) is not 
singular. Similarly, the frequency response lI(ej"' T ) of a stable digital filter is analytic on the unit 
circle |z| = 1 and on the basis of analytic continuation, e J, ’ ,T can be replaced by z to obtain the 
transfer function //(-) of the digital filter, which is valid everywhere in the z plane except at points 
where H(z) is not singular. 

A.9 CONFORMAL TRANSFORMATIONS 

An equation of the form 


w = u + jv — F(z ) (A.57) 

where z = x + jy is, in effect, a transformation that will map points in the z plane to corresponding 
points in the w plane. If each and every point in the z plane maps to one and only one point in the w 
plane, and conversely, then the transformation is said to be one-to-one. 

An important class of transformations is the so-called class of conformal transformations. 
These are transformations that have the important property that intersecting curves in the z plane 
map into intersecting curves in the w plane such that the angles between the z plane curves at the 
point of intersection are equal to the corresponding angles in the w plane both in magnitude as well 
as sense. A conformal transformation is illustrated in Fig. A. 11 where d\ and Ch are equal to 6[ and 
& 2 , respectively. If the angles at intersection points are equal in magnitude but opposite in sense, then 
the transformation is said to be isogonal. 

Theorem A.6 If f(z) is analytic in a region 1Z, then the transformation in Eq. (A.57) is 
conformal for all points in 7 Z except at points where f(z) = 0 (see Ref. [1]). A 

Some standard conformal transformations are as follows: 

1. Translation 

w — z + er + jco (A.58a) 

It translates a point x + jy in the z plane to point x + a + j(y + jco) in the w plane. 

2. Rotation 

w — e* 0 z (A.58b) 

It rotates a point z = re^ in the z plane to a point w = re' (< ^ +0) in the w plane. 

3. Scaling 


w — Xz 


(A.58c) 
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Figure A.ll Conformal transformation. 


It scales a point z = re^ in the z plane to a point w = Xre' 1 '^ in the w plane. If X 
magnitude of z is scaled up, and if X < 1 it is scaled down. 

4. Rotation and scaling 

w = Xe^z 

It combines rotation as in item (2) and scaling as in item (3). 

5. Inversion 

1 

w = - 

z 

It inverts a point z = re 1 ' 1 ’ in the z plane to a point w = in the w plane. 

5. Inversion and scaling 


w 


/ 

z 


> 1 the 


(A.58d) 


(A.58e) 


(A.58f) 


It combines inversion with scaling. 
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6. Linear transformation 


w — Xz + <J + jco 

It combines translation and scaling as in items (1) and (3). 

7. Bilinear transformation 


(A.58g) 


w = — where a 8 — fiy ^ 0 

yz + 8 


(A.58h) 

Through straightforward algebraic manipulation, the transformation can be expressed as 

a By — a8 t 

w — —b —-= e + —— (A.58i) 

Y y(yz + 8) z + rj 

where 


a P y — a8 8 

e = — t, — -r- and r\ = - 

K 7 2 Y 

are constants. Now Eq. (A.58i) can be viewed as a series of transformations, namely, translation 

V0\ — z + v 


followed by inversion 


1 1 

w 2 = — =- 

w i z + 

followed by scaling 


w 3 = Zw 2 = —— 

z + V 


followed by translation 


w — S + W 2 = E H- 

z + r) 

The bilinear transformation maps circles in the z plane into circles in the w plane whose relative 
sizes and locations depend on constants a, ft, y , and 8 but by choosing a = y — 8 = 1 and ft — — 1 
the transformation would map the jco axis of the z plane onto the unit circle of the w plane. 

An interesting feature of conformal transformations is that small figures in the z plane map 
into similar figures in the w plane. However, this property does not extend to large figures. 

Conformal transformations are used in Chap. 10 for obtaining denormalized lowpass, highpass, 
bandpass, or bandstop analog filters from normalized lowpass analog filters, and in Chap. 11 for 
deriving digital filters of the standard types from a given lowpass digital filter. 
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APPENDIX 

B 


ELLIPTIC 

FUNCTIONS 


B.l INTRODUCTION 

The Jacobian elliptic functions are derived by employing the Legendre elliptic integral of the first 
kind. Their theory is quite extensive and is discussed in detail by Bowman [1] and Hancock [2, 3]. 
We provide here a brief but adequate treatment of this theory to facilitate the understanding of the 
derivation of the elliptic approximation in Chap. 10 [4]. 

B.2 ELLIPTIC INTEGRAL OF THE FIRST KIND 

The elliptic integral of the first kind can be expressed as 

/•* dd 

u = u((j>, k)= , (B.l) 

Jo sj\ —k 2 sin 2 6 

where 0 < k < 1. The parameter k is called the modulus and the upper limit of integration <j> is called 
the amplitude of the integral. Evidently, for a real value of <p, uif. k) is real and represents the area 
bounded by the curve 


f _ 1 

\/1 — k 2 sin 2 6 

and the vertical lines 0 = 0 and 0 = cf>. Plots of / and u(<p, k) for k = 0.995 are shown in Fig. B.l. 
The integrand I has minima equal to unity at 0 = 0, n, 2n ... and maxima equal to l/Vl — k 2 at 
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Figure B.l Plots of / versus 9 and u(<j >, k) versus (j> for k = 0.995. 


0 = 7r/2, 3;r/2, .... In effect, I is a periodic function of 0 with a period it. The area bounded by 
lines 9 = mt/2 and 9 — (n+ \)tt/2 is constant for any n because of the symmetry of / and is equal 
to the area bounded by lines 0 = 0 and 9 = it / 2. This area is referred to as the complete elliptic 
integral of the first kind and is given by 



I-tt/2 


= K = 


d9 


'o \J \ —k. 1 sin 2 9 


(B.2) 


(see Fig. B.l). 

As a consequence of the periodicity and symmetry of I, we can write 


u(nn + <pi, k) = 2 nK + u(4> i, k) 



where 0 < 4>\ < jr/2. That is, the elliptic integral for a given k and any real <p can be determined 
from a table giving the values of the integral in the interval 0 < <p < n/2. 

\fk = 0, Eq. (B.l) gives 


C<t> 

m(0, 0) = / dl9 — (p 

Jo 


and if k — 1, 


II 

tan( 

71 

+ t)} 

/o cos 9 

\ 

4 

2;J 


u((p, 1) = 
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Figure B.2 Plots of u versus cp for various values of k. 

according to standard integral tables. Hence u{cp, 0) increases linearly with cp, whereas u ( cp. 1) is 
discontinuous at <p = n /2. For 0 < cp < re/2 

u((p, 0) < u(cp, k) < u((p, 1) 

as can be seen in Fig. B.2. 

B.3 ELLIPTIC FUNCTIONS 

Figure B.2 demonstrates a one-to-one correspondence between u and cp. Thus for a given pair of 
values (u, k) there corresponds a unique amplitude (p such that 

(p = f(u,k ) 

The Jacobian elliptic functions are defined as 

sn(w, k) — sin cp (B.3) 

cn(w, k) = cos cp (B.4) 

dn(w, k) = yj\ — k 2 sin 2 cp (B.5) 

Many of the properties of elliptic functions follow directly from the properties of trigonometric 
functions. For example, we can write 

sn 2 ( m , k) + cii 2 ( m , k) = 1 
and k 1 sn 2 (w, k) + dn 2 {u, k) = 1 


and so forth. 


(B.6) 

(B.7) 
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Plots of the elliptic functions versus u can be constructed as in Fig. B.3. As can be seen, 
sn( m, k), cn (u, k), and dn(«, k) are periodic functions u with periods 4 K, 4 K, and 2 K, respectively, 
i.e., 

sn(n + 4 inK, k) — sn(«, k) (B.8) 

cn(n + 4 mK, k) — cn( m, k) (B.9) 

dn(;^ + 2mK, k) — dn (u, k) (B.10) 



Figure B.3 Plots of snfu, k), cn(u, k), and dn(«, k) versus u. 
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0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 

u/K 


( b ) 

Figure B.4 Effect of variations in k on the elliptic sine (a) sn(/t, k ) versus u, ( b ) sn(n, k) versus u/K. 

Variations in k tend to change the shape and period of the elliptic functions, as illustrated in 
Fig. B.4. i.e., the elliptic sine and cosine are generalizations of the conventional sine and cosine, 
respectively. 

If k — 0, we have 

u{<p, 0) = (p 

and so sn(w, 0) = sn(0, 0) = sin0 cn(M, 0) = cn(0, 0) = cos0 

that is, sn(«. k) and cn(n, k) become the usual sine and cosine functions of r/j. 
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B.4 IMAGINARY ARGUMENT 

Thus far the argument of the elliptic functions, namely, m, has been assumed to be a real quantity. 
By performing the integration of Eq. (B.l) over an appropriate path in a complex plane, the elliptic 
integral can assume complex values. Let us consider the case of imaginary value whereby 

jv = 

As in Sec. B.3, we can define 

sn(jv, 
cn(jv, 

dn (jv, 

These functions can be expressed in terms of elliptic functions that have real arguments, as we will 
now show. 

By applying the transformations 


d9 


lo y/l — k 2 sin 2 9 


k) — sin i/f 
k) = cos i/f 

k) = \J 1 — k 2 sin 2 i/f 


(B.l 1) 


(B.12) 
(B.l 3) 

(B. 14) 


sin 9 = j tan 9' sin \[r = j tan i/f' 


(B. 15) 


in Eq. (B.l 1), we have 


Alternatively, 


where k! , given by 



jdO ' 

vT — sin 2 9' + k 2 sin 2 9' 



d9' 

sj 1 - {k') 2 sin 2 9' 


k' = \J 1 - k 2 


is called the complementary modulus. Now, from Sec. B.3 

sn(i>, k') — sin^f' (B. 16) 

cn(u, k') — cos i y (B.17) 

dn(u, k') — \J 1 — ik') 2 sin 2 i/r' 


(B.l 8) 
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and, therefore, from Eqs. (B.12)-(B.18), 


sn (jv,k) 
cn( jv,k) 
dn (jv,k) 


j tan f = j 


sin y 
cos y 


1 


cn(u, k') 
dn(u, k') 
cn(i>, k') 


j sn(t>, k') 
cn(i>, k’) 


(B.19) 

(B.20) 

(B.21) 


By analogy with Eq. (B.2), the complementary complete integral of the first kind is given by 

, r /2 dO' 

K'= / . = 

Jo v 1 — ( k') 2 sin 2 O' 

This has a similar interpretation as K ; that is, it is the quarter period of sn( v, k') and cn(u, k') or the 
half period of dn(u, k'). 

The functions sn (jv, k ), cn(jv, k ), and dn(yT>, k) are periodic functions of jv, as can be seen 
in Fig. B.5, with periods j2K', jAK' , and j\K' , respectively, i.e., 


sn(jv + j2nK', k) — sn(y'i), k) 
cn(jv + jAnK' , k) — cn (jv, k) 
dn(jv + jAnK' , k) — dn(/u, k ) 



Figure B.5 Plots of \sn(jv, k)}/j, cn(jv , k), and dn( jv, k) versus v. 
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B.5 FORMULAS 

Elliptic functions, like trigonometric functions, are interrelated by many useful formulas. The most 
basic one is the addition formula, which is of the form 

sn(zi,&)cn(z 2 ,&)dn(z 2 ,fc) + cn(zi,fc)sn(z 2 , fc)dn(zi,fc) 
sn(zi + z 2 , k) = --- (B.22) 

where D = 1 — 1c sn 2 (zi, k) sn 2 (z 2 , k) 

The variables zi and z 2 can assume real or complex values. By using the above formula and 
Eqs. (B.6) and (B.7) we can show that 

cn(zi, k) cn(z 2 , k) — sn(zi, k) sn(z 2 , k) dn(zi, k) dn(z 2 , k) 
cn(zi + Z2, k) = --- (B.23) 

dn(zi, k) dn(z 2 , k) — k 2 sn(zi, k)sn(z 2 , k)cn(zi, k)cn(z 2 , k) 
dn(zi + Z2, k) = - - - (B.24) 

Another formula of interest is 


dn 2 ( Z k} — dn< ' S ’ ^ + Cn< ' Z ’ ^ 
V 2 ’ / 1 + cn (z,k) 


(B.25) 


B.6 PERIODICITY 

In the preceding sections we have demonstrated that sn(z, k), where z — u + jv, has a real period 
of 4 K if v = 0 and an imaginary period of 2 K' if u = 0. In fact these are general properties for any 
value of v or it as can be easily shown. From the addition formula 


sn(z + Am K, k) — 


sn(z, k) cn(AmK, k ) dn(4m/C k) + cn(z, k) sn(4 mK, k ) dn(z, k) 
1 — k 2 sn 2 (z, k) sn 2 (4 mK, k ) 


and since 


sn(4/«A', k) — sn(0, k) — 0 
cn(4/«A', k) — cn(0, k) = 1 
dn(4;«A', k) = dn(0, k) — 1 

according to Eqs. (B.8)-(B.10), it follows that 

sn(z + 4 mK, k) — sn(z, k) (B.26) 


Similarly, 


sn(z + j2nK', k) 


sn(z, k) cn(j2nK r , k) dn(j2nK r , k) + cn(z, k) sn(j2nK r , k) dn(z, k) 
1 — k 2 sn 2 (z, k) sn 2 (J2nK', k ) 
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and from Eqs. (B.19)-(B.21) 

jsn(2nK', k') 
cn(2 nK',k') ~ 

- 1 -= (- 1 )" 

cn(2 nK',k') 

dn(2 nK', k') 

— -- = (- 1 )" 

cn(2 nK',k') 

Hence we have 


sn(j2nK ', k ) = 
cn (j2nK r , k) = 
dn (j2nK r , k) = 


sn(z + j2nK ', k) — sn(z, k) (B.27) 

Therefore, by combining Eqs. (B.26) and (B.27) we obtain 

sn(z + AmK + j2nK', k ) = sn(z, k) 

that is, sn(z, k ) is a doubly periodic function of z with a real period of 4 K and an imaginary period 
of 2 K'. 

The z plane can be subdivided into period parallelograms by means of lines 
u = AmK and jv = j2nK' 

as illustrated in Fig. B.6. The specific parallelogram defined by vertices (0, 0), {AK, 0), (4 K, j2K'), 
and (0, j2K') is called the fundamental period parallelogram. If the value of sn(z, k) is known for 
each and every value of z within this parallelogram and along any two adjacent sides, the function 
is known over the entire z plane. 


jv 
J2K '' 


Z plane 


-4K 


4 K 


-P- K' 


Figure B.6 Period parallelograms of sn(z, k). 
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Similarly, the functions cn(z, k) and dn(z, k ) can be shown to be doubly periodic. The first has 
a real period of 4 K and an imaginary period of 4 A", whereas the second has a real period of 2K and 
an imaginary period of 4 K'. 

B.7 TRANSFORMATION 

The equation 


co = Vk sn(z, k) (B.28) 

is essentially a variable transformation that maps points in the z plane onto corresponding points in 
the co plane. Let us examine the mapping properties of this transformation. These are required in the 
derivation of F(co) in Sec. 10.6. 

A point z p as well as all points 


Z = Z p + 4m K + j2nK' 

map onto a single point in the co plane by virtue of the periodicity of sn(z, k). Hence, only points 
in the fundamental period parallelogram need be considered. Three domains of Vk sn(z, k) are of 
interest as follows: 


• Domain 1: z = u with 0 < u < K 

• Domain 2: z — K + jv with 0 < v < K' 

• Domain 3: z = u + j K' with 0 < u < K 

In domain 1, we have 


If u — 0, then 


= Vk sn(u, k) 


co — Vk sn(0, k) — 0 

and if u — K, we obtain 


co — Vk sn (K, k) = Vk 

that is, Eq. (B.28) maps points on the real axis of the z plane between 0 and K onto points on the 
real axis of the co plane between 0 and Vk. 

In domain 2, we have 


co = Vk sn(7T + jv, k) 
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From the addition formula 


\[k cn(_/i>, k ) dn(yu, k) 
1 — k 2 sn 2 (jv, k ) 

since cn(^f, k) — 0, and from Eqs. (B.19)-(B.21) 


\fk dn(w, k') 
cn 2 (i>, k') + k 2 sn 2 (u, k') 


(B.29) 


Now from Eqs. (B.6) and (B.7) 


cn 2 (i>, k r ) + k 2 sn 2 (t>, k') = 1 — sn 2 (u, k r ) + k 2 sn 2 (i>, k !) 

= 1 — ( k ') 2 sn 2 (v, k') = dn 2 (u, k') 


Therefore, Eq. (B.29) simplifies to 


VT 

dn(u, k ') 


If v = 0, then 


co — 


= Vk 

dn(0, k') 


and if v — K', we have 


Vk _ 1 

dn(AT', k') «Jk 


For v — K'/2, the use of Eq. (B.25) yields 


©= ——— = Vk 

da(K'/2, k’) 


1 + cn (K\ k r ) 
dn(K',k') + cn(K\k') 


1/2 


= 1 


Thus Eq. (B.28) maps points on the line z — K + jv for v between 0 and K' onto points on the 
real axis of the &> plane between -Jk and 1 j*Jk\ in particular, point z = K + jK'/2 maps onto point 
co — 1 . 

In domain 3, Eq. (B.28) assumes the form 


co — Vk sn(M + jK', k) 


and, as above, Eq. (B.22) yields 

1 

co — —= - 

V£ sn(n, k) 
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CO = —= - = OO 

\fk sn(0, k) 

and if u — K, we get 

1 1 

y/~k sn (K, k ) ~J~k 

i.e., points on line z = u + j K' with u between 0 and K map onto the real axis of the co plane between 
oo and 1 /yfk. 

By considering mirror-image points to those considered so far, the mapping depicted in Fig. B.7 
can be completed, where points A, B, ... map onto points A', B', .... 

B.8 SERIES REPRESENTATION 

Elliptic functions, like trigonometric functions, can be represented in terms of series. From Ref. [3] 
or [4], 


1 0i(z/2 K,q) 

Stl 4 ’ \Jk Oo(z/2K, q) 

(B.30) 

C n(z,k)= X [ Fe2(z/2K ’ q) 

V k e 0 (z/2K , q) 

(B.31) 

dn U,k) = ^ Z/2K ' q) 
e 0 (z/2K , q ) 

(B.32) 
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The parameter q is known as the modular constant and is given by 


q — e 


-nK'/K 


The functions 9q(z/ 2K, q) to 9?,(z/2K, q) are called theta functions and are given by 


OO 

Oo q) = 1 + 2^J-l) m tf m2 cos (2 m^j 

m =1 
00 

01 (2*) = 2(?1/4 E ( - iy ^ m(m+1) sin [ (2m + 


Tt Z 
2K 


00 


m(m+ 1) 


m =0 


12 ", + )g 


*(£■*) 


- 1 +2^y ,,2 cos ( 2 '«^) 

m=l ~ 


The above series converge rapidly and can be used to evaluate the elliptic functions to any 
desired degree of accuracy. 
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transfer function, 793 
loss, 471 

characteristic, 471 
function, 471 

maximum output power, 775 
microwave, 16 
passband, 472 
passive RLC, 15 
phase response, 470 
phase shift in, 470 
practical 

bandpass, 473^474 
bandstop, 473-474 
highpass, 473 
lowpass, 473 

maximum passband loss, 473 
minimum stopband loss, 473 
passband edge, 473 


stopband edge, 473 
representation in terms of 
continuous-time transfer 
functions, 466 
resonant circuits, 788-791 
s 2 -impedance elements, 802 
sensitivity considerations, 774-775 
stopband, 472 
switched-capacitor, 15 
time-domain response 

to an arbitrary excitation, 467 
in terms of the time convolution, 

466 

using inverse Laplace transform, 

467 

transformers, 784-786 
unit elements, 786-788 
unit-step response, 469 
voltage sources, 779-781 
wire interconnections 
parallel, 782 
series, 780 
zero-pole plot of 
loss function, 472 
transfer function, 472 
Analog integrator, 541 
Analog signals, 3 
Analog-to-digital (A/D) 
converter 
encoder, 303 
ideal, 305 
practical, 305 
quantization error, 305 
sample-and-hold device, 303 
interface, 4 
encoder, 4 
quantizer, 4 
sampler, 4 

Analysis section of a QMF bank, 840 
Analysis: 

network analysis by using 

Mason’s method, see Signal flow 
graphs 

the node-elimination method, see 
Signal flow graphs 
the shift operator, 143-144 
stability, see Stability 
time-domain, see Time-domain 
analysis 

Analytic continuation, 920-921 
Analytic part of a Laurent series, 916 
Analytic signals, 852 
Analyticity in complex analysis, 907 
Anderson, B. D. O., 219 
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Angle (argument) of a complex 
number, 894 

Angle of a rational algebraic function, 
906 

Annulus, 82 

of convergence, 84 
innermost, 103 
of a Laurent series, 915 
outermost, 85 

Anti symmetrical impulse response in 
nonrecursive filters, 427 
Antoniou, A., 634, 664 
Application of the z transform to 
discrete-time systems 
introduction to, 201 
Applications: 

of adaptive filters for 
channel equalization, 872 
signal enhancement, 873 
signal prediction, 873-874 
system identification, 872 
of analog filters, 16 
of Constantinides transformations, 
554 

of digital filters, 21 
frequency-division multiplex (FDM) 
system, 16-18 

frequency-division to time-division 
multiplex translation, 887 
of Hilbert transformers 
for the sampling of bandpassed 
signals, 861-862 
for single-sideband modulation, 
859-861 

processing of EKG signals, 23-24 
processing of stock exchange data, 
24-27 

of state-space method, 186 
time-division to frequency-division 
multiplex translation, 886 
of two-dimensional digital filters, 

881 

use of the FFT approach in signal 
processing, 376-382 
overlap-and-add method, 377-380 
overlap-and-save method, 

380-382 

window technique, 354-356 
Approximation error in recursive 
filters, 720 
Approximations: 
for analog filters, see 

Approximations for analog 
filters 


closed-form, 390 
direct, 390 
indirect, 390 
introduction to, 390 
iterative, 390 

for nonrecursive filters, see 
Nonrecursive filters 
for recursive filters, see Recursive 
filters 

for two-dimensional digital filters, 
881 

by using the McClellan 
transformation, 881 
by using singular-value 
decomposition, 881 
Approximations for analog filters: 
basic concepts, 465^474 
Bessel-Thomson: 

delay characteristics, 515 
gamma function, 514 
introduction to, 513 
loss characteristics, 515 
normalized transfer function, 

513 

properties, 514 
Butter worth: 
derivation, 475 
loss, 476 

loss characteristics, 476 
maximally flat property, 475 
maximum passband loss, 479 
minimum filter order, 479 
minimum stopband loss, 479 
normalized transfer function, 476 
zero-pole plots of loss function, 
478 

Chebyshev: 

derivation, 481^-85 
fourth-order, 481-484 
introduction to, 481 
loss, 485 

loss characteristics, 486 
minimum filter order, 490^491 
normalized transfer function, 489 
nth-order, 484-485 
properties, 482 

zero-pole plots of loss function, 
488 

zeros of loss function, 485^487 
definition, 474 
denormalized, 475 
elliptic: 

derivation, 497-508 
discrimination factor, 497 


elliptic functions, 500 
elliptic integral, 499 
even-order, 507-508 
fifth-order, 497-504 
infinite-loss frequencies, 503 
introduction to, 497 
loss, 497 

loss characteristic, 498 
minimum filter order, 509 
minimum stopband loss, 509 
modular constant, 507 
normalized transfer function, 
509-512 
odd-order, 504 

plots of minimum stopband loss 
versus selectivity, 510 
properties, 498 
selectivity factor, 497 
specification constraint, 508-509 
zero-loss frequencies, 502 
zeros and poles of loss function, 
504-507 
ideal, 471^172 
introduction to, 463 
inverse-Chebyshev: 
derivation, 522 
introduction to, 493 
loss, 493 

loss characteristics, 486 
maximum passband loss, 496 
minimum filter order, 494 
normalized transfer function, 
493^194 
normalized, 475 
Argand diagrams, 893 
Argand, J.-R., 893 

Arithmetic, see Computer arithmetic 
Associative law of algebra, 144 
Attenuation in analog filters, 470 
Attenuation in discrete-time systems, 
227 

Autocorrelation function 
in continuous-time random 
processes, 602 

in discrete-time random processes, 
609 

Avenhaus, E., 628 
Babbage, C., 20 

Backward difference, Vx(nT), of 
numerical analysis, 454 
Bandpass CGIC second-order section, 
816 

Bandpass filtering, 8 
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Bandpass filters 
nonrecursive 

design of filters satisfying 
prescribed specifications, 450 
recursive 

design of filters satisfying 
prescribed specifications, 
568-573 

Bandpass transfer function 
discrete-time 

second-order, 249 
Bandpassed signals, 861-862 
Bandstop (notch) transfer function 
discrete-time 

second-order, 250 
Bandstop filtering, 8 
Bandstop filters 
nonrecursive 

design of filters satisfying 
prescribed specifications, 450 
recursive 

design of filters satisfying 
prescribed specifications, 573 
Barnwell, III, T. P., 849 
Bartlett (triangular) window function 
discrete-time, 385 
Base period, 30 
Baseband, 120, 232 
Bessel 

function zeroth-order modified of the 
first kind, 346 
functions, 514 
polynomial, 513 
Bessel-Thomson approximation: 
delay characteristics, 515 
example, 516 
gamma function, 514 
introduction to, 513 
loss characteristics, 515 
normalized transfer function, 513 
properties, 514 
Bias in floating-point number 
representation, 624 
BIBO stability, see Bounded-input, 
bounded-output stability 
Bilinear-transformation method, 
541-545 

derivation of, 541-543 
design formulas, 548 
example, 547-549 
mapping properties, 543-545 
prescribed specifications, see 
Prescribed specifications 
prewarping technique, 546 


warping effect, 545-548 

influence on amplitude response, 
546 

influence on phase response, 548 
in wave digital filters, 802 
Binary number system, 618-625 
Binary point, 618 
Binomial series, 103, 914 
Bits, 618 

Blackman, R. B., 20 
Blackman window function, 439 
main-lobe width in, 439 
ripple ratio in, 439 
Block-optimal structures, 649 
Bode, H. W., 20 
Bombelli, R., 892 
Bounded-input, bounded-output 
(BIBO) stability, 172 
Bowman, F., 925 

Branch cut in a function of a complex 
variable, 904 

Branch point in a function of a complex 
variable, 909 

B roy den-Fletcher- Goldfarb-S hanno 

(BFGS) updating formula, 730 
Bruton, L. T., 802,811 
Burrus, C. S., 633 
Butterfly signal flow graphs in FFT 
algorithms, 363 
Butterworth approximation: 
derivation, 475 

design of recursive filters satisfying 
prescribed specifications, 
573-574 

examples, 477^-78, 480-481 
loss, 476 

loss characteristics, 476 
maximally flat property, 475 
maximum passband loss, 479 
minimum filter order, 479 
minimum stopband loss, 479 
normalized transfer function, 476 
zero-pole plots of loss function, 478 

Canonic realizations (structures), 395 
Cardano, G., 892 

Cartesian representation of complex 
numbers, 893 
Cascade realization 
signal scaling, 645 
example, 645-646 
ordering of filter sections, 647 
Cascade realization method, 404-406 
example, 406 


Cascade wave digital filters: 
allpass CGIC section, 817 
bandpass CGIC section, 816 
CGIC realization, 811-812 
design procedure, 814-815 
example, 816-817 
digital G-CGIC configuration, 
812-814 

highpass CGIC section, 815 
lowpass CGIC section, 815 
notch CGIC section, 816 
output noise, 818-819 
power spectral density, 819 
scaling, 817-818 
Cauchy, A.-L., 908 

Cauchy-Riemann equations in complex 
analysis, 907 

Cauer forms of analog networks, 793 
Causal discrete-time systems, 136 
Central difference, 8x(nT), of 
numerical analysis, 454 
Central-limit theorem, 630 
CGIC, see Generalized-immittance 
converter, current-conversion 
type 

Chain matrix in analog LC filters, 787 
Chan, D. S. K., 701 
Characteristic impedance in unit 
elements, 786 

Characteristic polynomial, 211 
Characterization of 
analog filters 

by wave characterization, see 
Wave network characterization 
discrete-time systems 

by state-space equations, see 
State-space characterization 
nonrecursive discrete-time systems 
by difference equation, 140 
recursive discrete-time systems 
by difference equation, 141 
Charalambous, C., 739 
Charalambous minimax algorithm, 
740-741 

objective function, 739-740 
Chebyshev, R L., 481 
Chebyshev approximation: 
derivation, 481-485 
design of recursive filters satisfying 
prescribed specifications, 
575-576 

examples, 490-492 
fourth-order, 481-484 
introduction to, 481 
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loss, 485 

loss characteristics, 486 
minimum filter order, 490-491 
normalized transfer function, 489 
rcth-order, 484-485 
properties, 482 

zero-pole plots of loss function, 488 
zeros of loss function, 485-487 
Chebyshev polynomial, 441, 484 
Circle of convergence of a power 
series, 914 

Circulators in analog LC filters, 788 
Claasen, T. A. C. M., 666 
Closed-form approximations, 390 
Coefficient quantization, 627-632 
error, 617 

low-sensitivity structures, 632-637 
normalized sensitivity, 632 
optimum word length, 628 
sensitivity of the 

amplitude response, 629 
phase response, 631 
statistical word length, 630 
Cofactor of a matrix, 206 
Common factors in rational functions, 
214-215 

example, 215-216 
test for, 215 

Common region of convergence, 91 
Commutative law of algebra, 144 
Complementary complete elliptic 
integral, 931 

Complementary modulus, 930 
Complete elliptic integral of the first 
kind, 926 
Complex analysis: 

absolute convergence of a series, 
912 

analytic continuation, 920-921 
analyticity, 907 
binomial series, 914 
branch point in a function of a 
complex variable, 909 
Cauchy-Riemann equations, 907 
circle of convergence of a power 
series, 914 

conformal transformations: 
bilinear, 923 

inversion and scaling, 922 

isogonal, 921 

linear, 923 

rotation, 921 

rotation and scaling, 922 

scaling, 921 


translation, 921 
convergence of a series, 912 
derivative, 907 
differentiability, 907 
entire functions, 911 
essential singularities, 909 
geometric series, 913 
holomorphic functions, 907 
introduction to, 891 
isolated singularities, 909 
Laurent series: 
analytic part, 916 
annulus of convergence, 915 
principal part, 916 
relation with Maclaurin series, 919 
relation with Taylor series, 

919 

residue of a pole, 917 
Laurent theorem, 915 

annulus of convergence, 915 
open annulus, 915 
limit, 906 

meromorphic functions, 911 
multiplier constant in a rational 
function, 910 

nonisolated singularities, 909 
rcth-order pole in a rational algebraic 
function, 909 

nth-order zero at infinity, 908 
nth-order zero in a rational algebraic 
function, 908 

nth partial sum of a series, 911 
nth remainder of a series, 911 
Pascal triangle, 914 
pole at infinity, 909 
power series, 912 
radius of convergence of a power 
series, 914 

ratio test for the convergence of a 
series, 912 

region of convergence of a power 
series, 913 

regular functions, 907 
residue theorem, 919 
series of complex numbers, 911 
simple poles in a rational algebraic 
function, 909 

simple zeros in a rational algebraic 
function, 908 
singular points, 908 
sum of a geometric series, 913 
sum of a series, 911 
uniform convergence in a power 
series, 913 


zero-pole plot of a rational algebraic 
function, 910 

zeros in a rational algebraic function, 
908 

Complex conjugate, 894 
Complex convolution 

application in the design of 

nonrecursive filters, 434^-35 
Complex convolution theorem of z 
transform, 91 

Complex differentiation theorem of z 
transform, 87 
Complex numbers: 
addition, 894 
angle (argument), 894 
Argand diagrams, 893 
Cartesian representation, 893 
complex conjugate, 894 
De Moivre’s theorem, 894-895 
division, 896 

equality of two complex numbers, 
893 

Euler’s formula, 895-896 
exponential form, 896 
imaginary part, 892 
imaginary unit, 893 
magnitude (radius), 894 
multiplication, 894, 896 
nth power, 897 

nth root of a complex number, 

895 

parallelogram law, 897 
polar representation, 894 
ratio of products, 896 
real part, 892 

relation between the sum of the 
magnitudes and the magnitude 
of the sum of a set of complex 
numbers, 897 
Riemann sphere, 898 
spherical representation, 898 
square-root of a complex number, 
902 

subtraction, 894 
vector representation, 897 
Complex scale change theorem of z 
transform, 87 
Compression, 831 
Compressor, 831 
Computability, 175-176 

delay-free loops in signal flow 
graphs, 175 

Computation of IDFT using FFT 
algorithms, 322 
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Computational complexity of 
FFT algorithms, 369 
Remez exchange algorithm, 683 
Computer arithmetic: 

disadvantages of fixed-point 
arithmetic, 623-624 
examples, 623 
fixed-point, 620-623 
floating-point, 623-625 
addition, 624 
multiplication, 624 
number representation 

bias in floating-point number 
representation, 624 
binary number system, 618-625 
binary point, 618 
bits, 618 

conversion from binary to decimal 
numbers, 619 

conversion from decimal to binary 
numbers, 619 
end-around carry, 622 
exponent, 624 
IEEE Floating-point 
representation, 624 
mantissa, 624 
number normalization in 

floating-point arithmetic, 624 
number quantization, 625-627 
one’s complement, 621 
one’s complement of a negative 
number, 621 
radix, 618 
radix point, 618 
rounding, 625 
sign bit, 621 
signed-magnitude, 621 
significand, 624 
truncation, 625 
two’s complement, 621-622 
two’s complement of a negative 
number, 622 
word length, 621 
one’s complement 
addition, 622 
multiplication, 622 
overflow in one’s- or 

two’s-complement addition, 

623 

signed-magnitude 
arithmetic, 622 
multiplication, 622 
two’s complement 
addition, 622 


arithmetic, 622 
multiplication, 622 
Concurrency 

in hardware implementations, 412 
Condition for 

causality in discrete-time systems, 
136-137 

linearity in discrete-time systems, 
132-133 
stability on 

eigenvalues, 211 
impulse response, 172 
poles, 210 

time-invariance in discrete-time 
systems, 134 

Conformal transformations: 
bilinear, 923 

in complex convolution, 92 
inversion and scaling, 922 
isogonal, 921 
linear, 923 
rotation, 921 
rotation and scaling, 922 
scaling, 921 
translation, 921 

Constant-input limit cycles, 664 
Constant-delay 

allpass transfer function, 524 
nonrecursive filters, 426^128 
recursive filters, 586-587 
Constantinides transformations: 
application, 554 
general, 549-551 
lowpass-to-bandpass, 553 
lowpass-to-bandstop, 552-553 
lowpass-to-highpass, 553 
lowpass-to-lowpass, 551-552 
mapping properties, 550 
table, 553 
Constraint on 

eigenvalues for stability, 211 
impulse response for stability, 172 
poles for stability, 210 
Continuous-time signals: 
definition, 2 

processing by using digital filters, 
298-301 

example, 301-303 
spectral energy, 337 
spectral relation with discrete-time 
signals, 290-292 

Continuous-time unit-step function, 56 
Continuous-time window functions, 
337-347 


effect on frequency spectrum, 
339-343 

example, 343-346 
Kaiser window, 346-347 
Bessel function, 346 
frequency spectrum of, 346 
main-lobe width in, 348 
ripple ratio in, 348 
main-lobe width, 338 
rectangular window, 337 
frequency spectrum, 338 
ripple ratio in, 339 
ripple ratio, 338 
window length, 338 
Convergence 
annulus of, 84 

factor in adaptive filters, 867 
of Fourier series, 36 
of Fourier transform, 58 
radius of, 82 
of a series, 912 
of z transform, 81 
Conversion from 

binary to decimal numbers, 619 
example, 619 

decimal to binary numbers, 619 
example, 619 
Convex functions, 722 
Convolution summation, 88, 163-166 
decomposition of a discrete-time 
signal into a sum of impulses, 
164 

derivation, 163-164 
examples, 166-169 
graphical representation, 165 
special forms, 164-166 
two-dimensional, 875 
Cooley, J. W., 321 

Corollary of initial-value theorem, 89 
Correction of multiplier constant in 
recursive filters, 539 
Correction of phase response, 
234-235 

Correction of the angle of a rational 
algebraic function, 906 
Crochiere, R. E., 628 
Cross correlation in adaptive filters, 
866 

Cubic interpolation search in Remez 
exchange algorithm, 687-689 
Cutoff frequency in analog filters, 

472 

Cyclic convolutions, see Periodic 
convolutions 
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D/A, see Digital-to-analog 
Davidon-Fletcher-Powell (DFP) 
updating formula, 730 
De Moivre’s theorem, 894-895 
Deadband effect, 654 
Deadband range in limit cycles, 656 
Decimation-in-frequency algorithm 
8-point FFT, 374-375 
A-point FFT, 370-373 
Decimation-in-time algorithm 
8-point FFT, 368-369 
A-point FFT, 362-368 
Decimators, 830-833 
Decomposition section of a QMF bank, 
840 

Definition of 

a continuous-time random process, 
598 

random variable, 593 
transfer function, 202 
z transform, 80 
Delay characteristic, 252 
Delay characteristics in 
analog filters, 470 
Bessel-Thomson filters, 515 
Delay distortion in discrete-time 
systems, 253 

Delay equalization in recursive filters, 
586-587 

Delay-free loops in 

digital filters derived from analog 
filters, 775 

signal flow graphs, 175 
Denormalized approximations, 475 
Derivation of 

Bessel-Thomson approximation, 

513 

bilinear transformation method, 
541-543 

Butterworth approximation, 475 
Chebyshev approximation, 481-485 
convolution summation, 163-164 
elliptic approximation, 497-508 
Fourier transform, 47-^19 
inverse-Chebyshev filters, 522 
inverse-Fourier transform, 49-50 
transfer function from 

difference equation, 202-203 
state-space characterization, 205 
system network, 204 
Derivative of a function of a complex 
variable, 907 
Descartes, A. R., 893 
Descent direction, 724 


Design: 

approximation step, 390 
of cascade wave digital filters, see 
Cascade wave realization 
of decimators and interpolators, 839 
effects of arithmetic errors 
introduction to, 391 
general considerations, 412 
of Hilbert transformers, 854-856 
example, 856-858 
implementation, see Hardware or 
Software implementation 
implementation step, 391 
introduction to, 389-391 
nonrecurring costs, 412 
of nonrecursive filters, see 
Nonrecursive filters 
of nonrecursive filters by 

optimization, see Nonrecursive 
filters by optimization 
of QMF banks, 846-848 
example, 848-849 
realization step, 390 
recurring costs, 412 
of recursive filters, see Recursive 
filters 

of recursive filters by optimization, 
see Recursive filters by 
optimization 

of wave digital filters, see Wave 
digital filters 
Determinant of 
a 3 x 3 matrix, 213 
a general matrix, 206 
a signal flow graph, 154 
DFT, see Discrete Fourier transform 
Differentiability in complex analysis, 
907 

Differentiation (numerical) formulas, 
455 

Digital differentiators: 
design by using numerical-analysis 
formulas, 455 
example, 456^-57 
design by using the Fourier series 
method 

example, 457^-58 
by optimization: 
first derivative, 708 
ideal frequency response, 707 
minimum differentiator length, 
708-709 

prescribed specifications, 708 
problem formulation, 707-708 


using the Fourier series method, 

457 

Digital filters: 

amplitude equalization, 588 
applications, 21 

approximations, see Approximations 
choice of structure, 819-820 
definition, 19 

delay equalization, 586-587 
design, see Design 
effects of arithmetic errors 
introduction to, 391 
families of, 21 

frequency response, 232-235 
hardware, 22 

historical evolution, 19-20 
implementation, see Implementation 
overflow, 640 

processing of continuous-time 
signals by using, 298-301 
example, 301-303 
realization, see Realization 
software, 22 

software implementation by using 
the FFT approach, 376-377 
structures, see Structures 
transfer functions: 
first-order, 246 
first-order allpass, 246 
high-order, 251 
high-order allpass, 587 
second-order allpass, 251 
second-order bandpass, 249 
second-order highpass, 248 
second-order lowpass, 246-247 
second-order notch, 250 
zero-phase (zero-delay) filters, 
587-588 

Digital integrator, 542 
Digital signal processing (DSP) 
introduction to, 1 
Digital signals, 3 
Digital systems 
merits of, 21 
Digital-to-analog (D/A) 
converter 

example, 309-310 
ideal, 306 
model, 306-307 
practical, 305 
response, 307 
interface, 4 

smoothing device, 4 
Diniz, P. S. R., 634, 664 
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Direct approximation methods, 390 
Direct canonic realization method, 
395-396 

Direct paths in signal flow graphs, 154 
Direct realization method, 392-393 
Directed branches in signal flow 
graphs, 147 

Dirichlet conditions, 36 
Discrete active RC filters, 15 
Discrete Fourier transform (DFT): 
amplitude spectrum, 322 
of complex signals, 383 
definition, 322 
example, 324—325 
FFT algorithms, see Fast 

Fourier-transform algorithms 
frequency-domain sampling 
theorem, 328-333 
frequency spectrum, 322 
introduction to, 321 
inverse, 322-323 
linearity of, 323 
operator notation, 322 
periodic convolutions, 358-362 
periodicity, 323 
phase spectrum, 322 
relation with 

continuous Fourier transform, 
333-335 

Fourier series, 335-336 
z transform, 325-327 
simplified notation, 358 
symmetry of, 323-324 
window technique, 354 
application, 354-356 
example, 356-358 
introduction to, 337 
zero padding, 327-329 
Discrete-time sampling, 831 
by a noninteger factor, 839 
Discrete-time signals: 
amplitude spectrum, 119 
definition, 2 
exponential, 95 
frequency spectrum, 119 
notation, 7 
phase spectrum, 119 
sinusoid, 95 
spectral relation with 

continuous-time signals, 
290-292 

time 

denormalization, 7 
normalization, 7 


unit impulse, 95 
unit ramp, 95 
unit step, 95 
Discrete-time systems: 
absolute (phase) delay, 252 
amplitude distortion, 253 
amplitude response 

in first-order systems, 161 
of a system of arbitrary order, 
226 

attenuation, 227 
causality, 136 
computability, 175-176 
delay distortion, 253 
elements 
adder, 142 
multiplier, 142 
unit delay, 142 
excitation (input), 132 
frequency response, 161, 226 
group delay, 252 
implementation, 146 
initially relaxed, 134 
instability in, 161 
introduction to, 131 
linear, 132 
linearity, 132-133 
additivity condition, 133 
homogeneity condition, 133 
proportionality condition, 133 
superposition condition, 133 
network analysis by using 

Mason’s method, see Signal flow 
graphs 

the node-elimination method, see 
Signal flow graphs 
the shift operator, 143-144 
nonlinear, 133 
nonrecursive: 

characterization by difference 
equation, 140 

relation with FIR and systems, 
170-171 
stability, 210 
system order, 140 
operation, 147 
phase distortion, 253 
phase response 
ambiguity in, 232 
correction of, 234—235 
in systems of arbitrary order, 

226 

phase response in first-order 
systems, 161 


recursive: 

characterization by difference 
equation, 141 
relation with HR systems, 

170-171 

system order, 141 
relaxed, 134 
representation by 
networks, 143 
operator notation, 132 
signal flow graphs, 147-148 
state-space equations, 176-178 
response (output), 132 
rule of correspondence in, 132 
sampling theorem, see Sampling 
theorem 

stability, see Stability 
state-space characterization, see 
State-space characterization 
test for 

causality, 136-137 
linearity, 132-133 
time-invariance, 134 
time invariance, 134 
time-dependent systems, 134 
time-domain analysis, see 
Time-domain analysis 
transfer function, see Transfer 
function: discrete-time 
Discrete-time window functions: 
Bartlett (triangular) window, 385 
Blackman window, 439 
Dolph-Chebyshev window, 

440^144 

Hamming window, 437 
Kaiser window, 350, 445 
frequency spectrum of, 351 
z transform of, 351 
rectangular window, 350, 435 
frequency spectrum of, 350 
z transform of, 350 
Saramaki window, 453 
trade-off between main-lobe width 
and ripple ratio in the design of 
nonrecursive filters, 439 
ultraspherical window, 453 
von Hann window, 437 
Discrimination factor 

elliptic approximation, 497 
Distribution nodes in signal flow 
graphs, 147 

Distributive law of algebra, 144 
Division in complex arithmetic, 894, 
896 
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Dolph-Chebyshev window, 

440-442 

example, 442—444 
main-lobe width in, 441 
normalization of amplitude response, 
442 

ripple ratio in, 440 

Double periodicity in elliptic functions, 
933 

Downsampler, 831 
Downsampling, 831 
Duality principle in optimization 
theory, 736 

Ebert, P. M., 660 
Effects of arithmetic errors 
introduction to, 391 
Effects of finite word length 
introduction to, 617-618 
Efficient Remez exchange algorithm, 
691-693 
Eigenvalues, 211 
Elementary discrete-time signals: 
exponential, 95 
sinusoid, 95 
unit impulse, 95 
unit ramp, 95 
unit step, 95 

Elements of discrete-time systems 
adder, 142 
multiplier, 142 
unit delay, 142 
Elimination of 

aliasing errors in QMF banks, 
844-846 

constant-input limit cycles, 664 
nodes with multiple incoming and 
multiple outgoing branches in 
signal flow graphs, 149 
overflow limit cycles, 665-666 
parallel branches in signal flow 
graphs, 149 

quantization limit cycles, 660-663 
example, 663-664 
quantization limit cycles in wave 
digital filters, 808-810 
pseudopower, 808 
stored power, 808 
self loops in signal flow graphs, 

150 

series branches in signal flow graphs, 
148 

Elliptic approximation: 
derivation, 497-508 


design of recursive filters satisfying 
prescribed specifications, 
576-577 

discrimination factor, 497 
elliptic functions, 500 
elliptic integral, 499 
even-order, 507-508 
example, 512-513 
fifth-order, 497-504 
infinite-loss frequencies, 503 
introduction to, 497 
loss, 497 

loss characteristic, 498 
minimum filter order, 509 
minimum stopband loss, 509 
modular constant, 507 
normalized transfer function, 
509-512 
odd-order, 504 

plots of minimum stopband loss 
versus selectivity, 510 
properties, 498 
selectivity factor, 497 
specification constraint, 508-509 
zero-loss frequencies, 502 
zeros and poles of loss function, 
504-507 

Elliptic functions: 

addition formulas, 932 
definition, 927 
double periodicity, 933 
effect of variations in the modulus on 
the elliptic functions, 928 
in elliptic approximation, 500 
fundamental period parallelogram, 
933 

imaginary argument, 930-931 
imaginary period, 932 
introduction to, 925 
modular constant, 937 
period parallelograms, 933 
periodicity, 932-934 
plots, 928 

series representation, 936-937 
theta functions, 937 
transformation co = vT sn(z, k ), 934 
mapping properties, 934-936 
Elliptic integral: 
amplitude, 925 

complementary complete, 931 
complementary modulus, 930 
complete, 926 
definition, 925 

in elliptic approximation, 499 


of the first kind, 925 
modulus, 925 
Encoder, 4, 303 
End-around carry, 622 
Energy spectral density of nonperiodic 
signals, 63 

Energy spectrum of nonperiodic 
signals, 63 

Ensemble in continuous-time random 
processes, 598 

Entire functions of a complex variable, 
911 

Equality of two complex numbers, 893 
Equalizers by optimization: 
algorithm, 757-758 
examples, 759-765 
Equally terminated LC filters, 774 
Equiripple solution, 441 
Equivalent impulse functions, 268 
Error function in nonrecursive filters, 
681 

Error function in recursive 
filters, 720, 745 
recursive equalizers, 756 
Error-spectrum shaping, 651-654 
noise model for, 651 
PSD of output noise, 651 
signal-to-noise ratio, 653 
Errors: 

coefficient quantization, 617 
input quantization, 617 
introduced by rounding, 626 
introduced by truncation, 626 
product quantization, 617 
Essential singularities in complex 
analysis, 909 
Eswaran, C., 637, 819 
Euclidean 
norm, 722 
space, 724 

Euler’s formula, 895-896 
Euler-Fourier formulas, 33 
Evaluation of frequency spectrum, 119 
Excitation in discrete-time systems, 132 
Exhaustive step-by-step search, 680 
Expander, 833 
Expected value 

in adaptive filters, 866 
of a random variable, 595 
of a random variable that depends on 
two or more variables, 596 
Exponent, 624 

Exponential excitation in first-order 
systems, 158-159 
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Exponential form of a complex 
number, 896 

Extrapolation in quasi-Newton 
algorithm, 733 

Extremal frequencies (or extremals) in 
nonrecursive filters, 678 

Fan two-dimensional digital filters, 880 
Fast Fourier-transform (FFT) 
algorithms: 

application to signal processing, 
376-382 

overlap-and-add method, 377-380 
overlap-and-save method, 

380-382 

butterfly signal flow graph, 363 
computation of inverse DFT using, 
375 

computational complexity, 369 
decimation-in-frequency 
8-point FFT, 374-375 
N-point FFT, 370-373 
decimation-in-time 
8-point FFT, 368-369 
N -point FFT, 362-368 
introduction to, 362 
number of multiplications in, 369 
FDNR networks, 802 
Feasible stability region for recursive 
filters and equalizers, 755 
Feldkeller equation, 796, 849 
Fettweis, A., 773, 802, 808 
FFT, see Fast Fourier-transform 
algorithms 
Filtering: 
bandpass, 8 
bandstop, 8 
definition, 8, 12 
highpass, 8 
lowpass, 8 

Filtering of discrete-time random 
processes, 610-611 
example, 612 
Filters: 

analog, see Analog filters 
digital, see Digital filters 
electrical, 13 

Final value of a signal, 469 
Final-value theorem of z transform, 90 
FIR filters, see Nonrecursive filters 
FIR systems, see Discrete-time 
systems: nonrecursive 
First-order statistics in continuous-time 
random processes, 599 


Fixed-point arithmetic, 620-623 
Fletcher inexact line search, 733 
Fletcher, R., 729, 734 
Flip-flop as a memory device, 619 
Floating-point 
addition, 624 
arithmetic, 623-625 
multiplication, 624 
Forced response, 666 
Forward difference, A x(nT), of 
numerical analysis, 454 
Foster forms of analog networks, 

793 

Fourier, J. B. J., 30 
Fourier series: 

amplitude spectrum, 34 
of anti symmetrical signals, 35 
base period, 30 
of complex signals, 37 
definition, 30 

design of nonrecursive filters, 
431-432 

Dirichlet conditions, 36 
of even functions, 34 
examples, 39—46 
frequency spectrum, 34 
fundamental, 34 
general form, 30 
harmonics, 34 
introduction to, 29 
kernel 

defined, 278 
theorem, 278 
of odd functions, 35 
periodic continuation, 30 
phase spectrum, 34 
relation with 
DFT, 335-336 
Fourier transform, 280-283 
of symmetrical signals, 34 
in terms of 

exponentials, 30 
sines and/or cosines, 33-34 
theorems 

convergence, 36 
least-squares approximation, 38 
Parseval’s formula, 37 
uniqueness, 39 
Fourier transform: 

amplitude spectrum in, 50 
of complex signals, 50 
of cos a)Qt, 273 
derivation of, 47-49 
energy spectral density, 63 


energy spectrum, 63 
examples, 54-57, 63-72, 276-278 
frequency spectrum in, 50 
of an impulse function, 266 
of impulse-modulated signals, 288 
introduction to, 29 
inverse of, 49-50 
operator notation, 50 
particular forms, 50-54 
of periodic signals, 274 
phase spectrum in, 50 
pitfalls associated with periodic 
signals, 272 
properties, 57-63 
relation with 
DFT, 333-335 
Fourier series, 280-283 
z transform, 288 
of sin coot, 213 

table of standard Fourier transforms, 
72, 275 
theorems: 

convergence, 58 
frequency convolution, 62 
frequency differentiation, 60 
frequency shifting, 60 
linearity, 58 
moments, 60 
Parseval’s formula, 62 
symmetry, 58 
time convolution, 61 
time differentiation, 60 
time scaling, 59 
time shifting, 60 
of unit step function, 274 
of unity function, 271 
Frequency convolution of Fourier 
transform, 62 

Frequency-dependent negative 

resistance (FDNR) networks, 
802 

Frequency differentiation theorem of 
Fourier transform, 60 
Frequency-division multiplex (FDM) 
system, 16-18 
Frequency-domain: 

aliasing, 229-231, 296-297 
impulse function, 271 
periodic convolution, 361 
theorem, 362 

sampling theorem, 328-333 
unity function, 266 
Frequency-domain analysis: 
for analog filters: 
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steady-state sinusoidal response, 
470 

examples, 236-245 
for two-dimensional digital filters, 
877 

using the z transform, 224-235 
for wave digital filters, 805-807 
Frequency-domain representation: 
of continuous-time random 
processes, 604-608 
example, 608 

Wiener-Khinchine relation, 608 
of discrete-time random processes, 
609-610 

of discrete-time signals 
amplitude spectrum, 119 
frequency spectrum, 119 
phase spectrum, 119 
of nonperiodic signals 
amplitude spectrum, 50 
frequency spectrum, 50 
phase spectrum, 50 
of periodic signals 

amplitude spectrum, 5, 34 
phase spectrum, 5, 34 
Frequency of limit cycle, 656 
Frequency response: 
amplitude response 
in analog filters, 470 
in first-order systems, 161 
in systems of arbitrary order, 226 
in analog filters, 470 
attenuation in analog filters, 470 
definition, 226 
delay characteristic, 252 
in analog filters, 470 
in digital filters, 232-235 
of discrete-time systems, 161 
examples, 236-245 
gain, 160 

gain in analog filters, 470 
graphical evaluation, 227-228 
group delay in analog filters, 470 
in Hilbert transformers, 858 
loss 

characteristic in analog filters, 471 
function in analog filters, 471 
in analog filters, 471 
in nonrecursive filters, 428-430 
formulas, 430 
periodicity, 229 
phase response, 161 
ambiguity in, 232 
in analog filters, 470 


correction in, 234-235 
in systems of arbitrary order, 226 
phase shift, 160 

in analog filters, 470 
in QMF banks, 847 
in two-dimensional digital filters, 

877 

Frequency shifting theorem of the 
Fourier transform, 60 
Frequency spectrum: 

of continuous-time Kaiser window, 
346 

of decaying sinusoid, 122-124 
in DFT, 322 

of discrete-time Kaiser window, 

351 

of discrete-time rectangular window, 
350 

discrete-time signals, 119 
of Hamming window, 438 
of Kaiser window, 445 
of nonperiodic signals, 50 
of periodic signals, 34 
periodicity of spectrum in 

discrete-time signals, 120 
of pulse signal, 120-122 
of rectangular window, 435 
of von Hann window, 438 
Functions of a complex variable: 
ambiguity in the determination of the 
angle of a rational algebraic 
function, 906 

angle of a rational algebraic 
function, 906 
branch cut, 904 

correction of the angle of a rational 
algebraic function, 906 
hyperbolic functions, 901 
identities, 901 
inverse 

algebraic functions, 900 
hyperbolic functions, 902 
trigonometric functions, 901 
magnitude of a rational algebraic 
function, 906 

multi-valued functions, 902-904 
periodic functions, 904-905 
polynomials, 899 
principal angle, 904 
rational algebraic functions, 905-906 
Riemann surface, 903-904 
trigonometric functions, 900 
identities, 901 

Fundamental in a Fourier series, 34 


Fundamental period parallelogram in 
elliptic functions, 933 

Gain, 160, 226 

in analog filters, 470 
in decibels (dBs), 227 
Gamma function, 514 
Ganapathy, V., 819 
Gauss, C. F., 892 
Gaussian function, 70 
Gaussian probability-density function, 
594 

Gazsi, L., 848 
G-CGIC configuration 
analog, 811-812 
digital, 812-814 

General form of Fourier series, 30 
General inversion method of z 
transform, 85-86 
Generalized functions, 274 
Generalized-immittance converter 
(GIC), 811 

admittance conversion function, 811 
current-conversion type (CGIC), 811 
Geometric series, 913 
Gibbs’ oscillations, 433 
GIC, see Generalized-immittance 
converter 

Global minimum, 725 
Gradient information for Remez 

exchange algorithm, 694-696 
Gradient of MSE in adaptive filters, 866 
Gradient vector 
definition, 723 
in equalizers, 756 
in minimax algorithm, 739 
in recursive filters, 746 
Gramians 

observability, 648 
reachability, 648 
Graphical evaluation 

frequency (amplitude and phase) 
response, 227-228 
Graphical representation: 

of convolution summation, 165 
of interrelations between 
continuous-time, 

impulse-modulated, and 
discrete-time signals, 297-298 
of time-domain periodic 
convolution, 359-361 
Gray, Jr., A. H., 401 
Green, B. D., 661 
Gregory, J., 20 
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Gregory-Newton interpolation 
formulas, 454 
Grossman, A. J., 497 
Group delay in 
analog filters, 470 
discrete-time systems, 252 
nonrecursive filters, 426 
two-dimensional digital filters, 877 

Hamming window function, 437 
frequency spectrum of, 438 
main-lobe width in, 439 
ripple ratio in, 438 
Hancock, H., 925 
Hardware digital filters, 22 
Hardware implementation: 
basics of, 412 
concurrency, 412 

general design considerations, 412 
introduction to, 391 
pipelining, 413 
processing elements, 412 
systolic, 412^-16 
example, 416-417 
latency, 414 
processing rate, 413 
in terms of VLSI chips, 412 
Harmonics in a Fourier series, 34 
Herrmann, O., 674, 701 
Hessian matrix, 723 
indefinite, 725 
negative definite, 725 
positive definite, 725 
Higgins, W. E., 653 
Higher-order central differences, 

8 n x(nT), of numerical analysis, 
454 

Highpass CGIC second-order section, 
815 

Highpass filtering, 8 
Highpass filters 
nonrecursive 

design of filters satisfying 
prescribed specifications, 450 
recursive 

design of filters satisfying 
prescribed specifications, 568 
two-dimensional digital, 880 
Highpass transfer function 
discrete-time 

second-order, 248 
Hilbert transform of a signal, 854 
Hilbert transformers: 
analytic signals, 852 


applications 

sampling of bandpassed signals, 
861-862 

single-sideband modulation, 
859-861 

design of, 854-856 
example, 856-858 
frequency response, 858 
introduction to, 851-852 
Hirano, K., 637 

Historical evolution of digital filters, 
19-20 

Hofstetter E., 674 
Holder inequality, 642 
Holomorphic functions in complex 
analysis, 907 

Homogeneity condition in 

discrete-time systems, 133 
Hurwitz polynomials in analog filters, 
794 

Hwang, S. Y., 647 
Hyperbolic functions, 901 
identities, 901 

Ideal analog filters 
bandpass, 472 
bandstop, 472 
highpass, 472 
lowpass, 471 

IDFT, see Inverse discrete Fourier 
transform 

IEEE Floating-point representation of 
numbers, 624 

HR filters, see Recursive filters 
HR systems, see Discrete-time systems: 
recursive 

Images produced by upsampling, 834 
Imaginary argument in elliptic 
functions, 930-931 
Imaginary part of a complex number, 
892 

Imaginary period in elliptic functions, 
932 

Imaginary unit, 893 

Impedances in analog LC filters, 778 

Implementation: 

of discrete-time systems, 146 
hardware 

concurrency, 412 
pipelining, 413 
processing elements, 412 
systolic, 412^-16 
in terms of VLSI chips, 412 
nonreal-time, 391 


real-time, 391 
software, 391 

Improved formulation for Remez 

exchange algorithm, 689-691 
Impulse functions, 263-272 
alternative equivalent impulse 
functions, 268 
definition, 265 
Fourier transform of 
an impulse function, 266 
a unity function, 271 
frequency-domain impulse function, 
271 

pitfalls associated with the definition 
of an impulse function, 263-265 
properties of 

frequency-domain impulse 
functions, 272 

time-domain impulse functions, 
269 

time-domain 

impulse function, 265 
unity function, 271 
Impulse-modulated filters, 298 

continuous-time transfer function of, 
299 

discrete-time transfer function of, 
299 

impulse response, 299 
Impulse-modulated signals: 

Fourier transform of, 288 
generation of, 286-288 
Laplace transform of, 291-292 
periodicity of spectrum, 291 
spectral relation with continuous- 
and discrete-time signals, 
290-292 

Impulse modulator, 286 
Impulse response: 
in analog filters, 469 
of first-order systems, 155-156 
of impulse-modulated filter, 299 
in nonrecursive filters 

antisymmetrical, odd filter length, 
705 

symmetrical, odd filter length, 683 
of Vth-order systems 

using mathematical induction, 163 
using the z transform, 207-208 
scaling in nonrecursive filters, 442 
using state-space characterization, 
185 

Incident wave quantity, 775 
Indirect approximations, 390 
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Indirect realization methods, 390 
Induction, see Mathematical induction 
Inexact line searches, 730-734 
Infinite-loss frequencies in elliptic 
filters, 503 
Initial conditions 
in analog filters, 466 
Initial value of a signal, 469 
Initial-value theorem of z transform, 89 
Initialization of extremals in Remez 
exchange algorithm, 679 
Initially relaxed 
analog filters, 466 
discrete-time systems, 134 
Innermost annulus of convergence, 103 
Input quantization error, 617 
Insertion loss in analog filters, 774 
Instability in discrete-time systems, 161 
Integrated active RC filters, 15 
Integration (numerical) formulas, 455 
Integrators 

using numerical-analysis formulas, 
455 

Interior band edge in nonrecursive 
filters, 680 
Interpolation 
formula, 296 

Gregory-Newton formula in terms of 
backward differences, 454 
forward differences, 454 
Lagrange barycentric formula, 681 
linear, 838 

in quasi-Newton algorithm, 733 
Stirling formula, 454 
Interpolation (numerical) formulas, 454 
Interpolators, 833-838 
example, 838-839 
Interrelation between 
continuous-time, 

impulse-modulated, and 
discrete-time signals, 288 
graphical representation, 297-298 
the discrete and continuous Fourier 
transforms, 333-335 
the discrete Fourier and z transforms, 
325-327 

the discrete Fourier transform and 
the Fourier series, 335-336 
the Fourier and z transforms, 288 
example, 289-290 
the Fourier series and the Fourier 
transform, 280-283 
example, 283-284 
Laplace and z transforms, 291-292 


the spectrums of continuous-time, 
impulse-modulated, and 
discrete-time signals, 290-292 
example, 292-293 
Invariant 

impulse-response method, 530-532 
example, 532-534 
merits and demerits, 532 
sinusoid-response method, 558 
unit-step-response method, 557 
Inverse 

algebraic functions, 900 
discrete Fourier transform (IDFT) 
computation of, 375 
definition of, 322 
Fourier transform 
derivation of, 49-50 
hyperbolic functions, 902 
Laplace transform, 465 
of a matrix, 206 
shift operator, 143 
trigonometric functions, 901 
z transform, 85 

Inverse-Chebyshev approximation: 
derivation, 522 

design of recursive filters satisfying 
prescribed specifications, 576 
example, 495^-96 
introduction to, 493 
loss, 493 

loss characteristics, 486 
maximum passband loss, 496 
minimum filter order, 494 
normalized transfer function, 
493^194 

Inversion techniques for z transform: 
general inversion method, 85-86 
example, 101-102 
use of binomial series, 103 
examples, 103-108 
use of convolution theorem, 108 
example, 108-110 
use of initial-value theorem, 113 
example, 113-114 
use of long division, 110-113 
example, 111-112 
use of partial fractions, 115-116 
example, 116-118 
Isolated singularities, 909 
Iterative approximation methods, 390 

Jackson, L. B., 21, 640, 647, 649, 654 
Joint distribution function 
definition, 594-595 


Joint probability-density function 
definition, 595 
Jury, E. I., 219 
Jury-Marden 
array, 219 

stability criterion, 219-220 
examples, 220-222 

Kaiser, J. F., 661 
Kaiser window function 
continuous-time, 346-347 
Bessel function, 346 
example, 347-349 
frequency spectrum of, 346 
main-lobe width in, 348 
ripple ratio in, 348 
discrete-time, 350 , 445 

frequency spectrum of, 351 , 445 
main-lobe width in, 445 
ripple ratio in, 445 
z transform of, 351 
Kim, Y., 649 

&th-order statistics in continuous-time 
random processes, 600 

L\ norm, 721 
L 2 norm, 722 

L 2 -scaling transformation, 650 
L 2 signal scaling, 643 
L 2 versus scaling, 643-645 
Ladder LC network, 799 
Ladder wave realization, 798-799 
example, 799-801 
transfer function, 799 
Lagrange barycentric interpolation 
formula, 681 
Lagrange, J. L., 20 
Laplace transform: 
definition, 465 
final value of a signal, 469 
of impulse-modulated signals, 
291-292 

initial value of a signal, 469 
operator notation, 466 
relation with 

z transform, 291-292 
Latency in systolic structures, 414 
Lattice LC network, 791 

alternative configuration, 792-796 
analysis, 791-792 
transfer function, 793 
Lattice realization method, 401^-04 

1- multiplier section, 403^104 

2- multiplier section, 403-404 
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Lattice realization method ( Cont .): 

example, 402^403 
Lattice wave realization, 796-797 
transfer function, 797 
example, 797-798 
Laurent, P., 915 
Laurent series: 
analytic part, 916 
annulus of convergence, 915 
principal part, 916 
relation with 

Maclaurin series, 919 
Taylor series, 919 
the z transform, 83-84 
residue of a pole, 917 
Laurent theorem, 915 

annulus of convergence, 915 
open annulus, 915 
Law of exponents for shift operator, 
143 

Laws of algebra, 144 
Least-mean-square algorithm, 870-871 
Least-/?th minimax algorithm, 739 
gradient vector, 739 
objective function, 739 
Least-squares approximation theorem 
of Fourier series, 38 
Least-squares solution, 722 
l’Hopital’s rule, 158 
Lighthill, M. J., 274 
Limit-cycle oscillations 

overflow limit cycles, see Overflow 
limit cycles 

quantization (granularity) limit 
cycles, see Quantization 
(granularity) limit cycles 
Limit in complex analysis, 906 
Lindgren, A. G., 649 
Line searches, 724 
Linear difference equation, 140 
Linear discrete-time systems, 132-133 
Linear-phase nonrecursive filters, 
426-428 
Linearity 
of DFT, 323 

of discrete-time systems, 132-133 
of Fourier transform, 58 
of shift operator, 143 
theorem 

of z transform, 86 
Linearly independent vectors, 727 
Liu, A., 21 
Liu, V., 661 
Local minima, 725 


Location of zeros in nonrecursive filters 
with constant group delay, 
430-431 
Long, J. L., 661 

Loop transmittances in signal flow 
graphs, 154 
Loss characteristics in: 
analog filters, 471 
Bessel-Thomson filters, 515 
Butterworth filters, 476 
Chebyshev filters, 486 
elliptic filters, 498 
inverse-Chebyshev filters, 486 
Loss function 

in analog filters, 471 
Loss in 

analog filters, 471 
Butterworth filters, 476 
Chebyshev filters, 485 
elliptic filters, 497 
inverse-Chebyshev filters, 493 
Lossless-discrete-integrator (LDI) 
ladder filters, 811 

Low-sensitivity structures, 632-637 
Lowpass CGIC second-order section, 
815 

Lowpass filtering, 8 
Lowpass filters 
nonrecursive 

design of filters satisfying 
prescribed specifications, 
445^47 
recursive 

design of filters satisfying 
prescribed specifications, 
565-568 

two-dimensional digital, 880 
Lowpass-to-bandpass transformation 
for analog filters, 516 

graphical interpretation, 519 
mapping, 518 
for digital filters, 553 
Lowpass-to-bandstop transformation 
for analog filters, 519 
for digital filters, 552-553 
Lowpass-to-highpass transformation 
for analog filters, 519 
for digital filters, 553 
Lowpass-to-lowpass transformation 
for analog filters, 516 

graphical interpretation, 517 
mapping, 517 
for digital filters, 551-552 
Lowpass transfer function 


discrete-time 

second-order, 246-247 
L p norm, 721 
L p signal scaling, 641-643 
Loo norm, 722 

Loo-scaling transformation, 650 
Loo signal scaling, 643 
Lyapunov 
equation, 222 
stability criterion, 222-223 

Magnitude of a rational algebraic 
function, 906 

Magnitude (radius) of a complex 
number, 894 
Main-lobe width: 

in Blackman window, 439 
in continuous-time window 
functions, 338 

in Dolph-Chebyshev window, 441 
in Hamming window, 439 
in Kaiser window, 445 
in Kaiser window function, 348 
in rectangular window, 435 
trade-off with ripple ratio in the 
design of nonrecursive filters, 
439 

in von Hann window, 439 
Mantissa, 624 

Mapping properties of bilinear 
transformation, 543-545 
Markel, J. D., 401 
Mason’s 

gain formula, 153 
method for network analysis, 
153-154 

example, 154-155 
Matched-z transformation method, 
538-539 

correction of multiplier constant, 
539 

example, 539-541 
merits and demerits, 539 
Mathematical induction as a tool for 

time-domain analysis, 155-163 
Matrices: 
adjoint, 211 

characteristic polynomial, 211 
cofactor, 206 
determinant of 
a 3 x 3 matrix, 213 
a general matrix, 206 
eigenvalues, 211 
inverse, 206 
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minor determinants (minors) 
defined, 206 
positive definite, 217 
principal minor determinants 

(minors) of an N x N matrix, 
217 

quadratic forms, 217 
Maxima of the error function in 
nonrecursive filters, 679 
Maximally flat property of Butterworth 
approximation, 475 
Maximum 

output power in analog filters, 

775 

passband loss in 

Butterworth filters, 479 
inverse-Chebyshev filters, 496 
practical analog filters, 473 
Mazo, J. E., 660 
McClellan, J. H., 674 
Mean of a discrete-time random 
process, 609 
Mean square 

of a discrete-time random process, 
609 

error (MSE) in adaptive filters, 

866 

(second moment) of a random 
variable, 596 

Mecklenbrauker, W. F. G., 666 
Meerkotter, K., 808 
Meerkotter’s realization, 663-664 
Merits of digital systems, 21 
Meromorphic functions, 911 
Microwave filters, 16 
Mills, W. L., 661 
Minimax algorithms, 738-745 
nonuniform variable sampling 
technique, 741-743 
virtual sample points, 742 
Minimax solution in recursive filters, 
722 

Minimization of output roundoff noise, 
647-650 

block-optimal structures, 649 
L 2 -scaling transformation, 

650 

Lqo- scaling transformation, 650 
noise model for error-spectrum 
shaping, 651 

observability gramian, 648 
PSD of output noise in 

error-spectrum shaping 
structure, 651 


reachability gramian, 648 
section-optimal structures, 649 
second-order, 649 
signal-to-noise ratio in 

error-spectrum shaping 
structure, 653 

in state-space structures, 648 
by using error-spectrum shaping, 
651-654 
Minimum 

filter length to achieve prescribed 
specifications 

in digital differentiators, 708-709 
in nonrecursive filters, 700-701 
filter order in 

Butterworth filters, 479 
Chebyshev filters, 490^-91 
elliptic filters, 509 
inverse-Chebyshev filters, 494 
point, 724 

stopband attenuation 

in nonrecursive filters, 444 
stopband loss in 

Butterworth filters, 479 
elliptic filters, 509 
practical analog filters, 473 
Minor determinants (minors) of a 
matrix defined, 206 
Mirror-image polynomials, 431 
Mitra, S. K., 810 

Modified invariant impulse-response 
method, 534-535 
example, 536-538 
merits and demerits, 535 
stabilization technique, 535 
Modular constant, 937 
in elliptic filters, 507 
Modulus of elliptic integral, 925 
Moments theorem of Fourier 
transform, 60 

MSE, see Mean-square error 
Mullis, C. T., 647, 661 
Multiband nonrecursive filters by 
optimization, 712-713 
example, 713-715 
Multiplication 

in complex arithmetic, 894, 896 
floating-point, 624 
one’s complement, 622 
signed-magnitude, 622 
two’s complement, 622 
Multiplier, 142 

Multiplier constant in a rational 
algebraic function, 910 


Multi-valued functions, 902-904 
Munson, Jr., D. C., 653 

Natural signals, 2 
Network analysis by using 

Mason’s method, see Signal flow 
graphs 

the node-elimination method, see 
Signal flow graphs 
the shift operator, 143-144 
example, 145-146 
Newton algorithm, 724 
in adaptive filters, 867 
convergence factor, 867 
disadvantages, 726 
example, 725-726 
Newton direction, 724 
Newton, I., 20 
Nishimura, S., 637 

Node-elimination method for network 
analysis, 148-153 
example, 150-152 
Noise model for 
multiplier, 638-639 
second-order canonic section, 639 
Noncausal discrete-time systems, 136 
Noncomputable signal flow graphs, 
176 

Nonisolated singularities, 909 
Nonlinear discrete-time systems, 

133 

Nonperiodic signals 
amplitude spectrum, 50 
frequency spectrum, 50 
phase spectrum, 50 
Nonquadratic functions, 724 
Nonquantized signals, 3 
Nonrecursive discrete-time systems, 
see Discrete-time systems: 
nonrecursive 
Nonrecursive filters: 

application of complex convolution, 
434-435 

comparisons with recursive filters, 
554 

constant-delay, 426-428 
design by using numerical-analysis 
formulas, 455 

design by using the Fourier series 
method, 431—432 
examples, 432^433, 439-440, 
442^144, 448-449, 451-453 
design by using window functions, 
434 



954 INDEX 


Nonrecursive filters ( Cont .): 

design of differentiators by using the 
Fourier series method, 457 
design of filters satisfying prescribed 
specifications 
bandpass, 450 
bandstop, 450 
highpass, 450 
lowpass, 445^147 
formulas for frequency response, 

430 

frequency response, 428-430 
Gibbs’ oscillations, 433 
group delay in, 426 
introduction to the approximation 
problem for, 425 
linear phase, 426^-28 
location of zeros in filters with 

constant group delay, 430-431 
minimum stopband attenuation, 444 
mirror-image polynomials, 431 
normalization of amplitude response, 
442 

by optimization: 

adjustable bracket, 689 
alternation theorem, 677-678 
alternative rejection scheme for 
superfluous potential extremals, 
682 

arbitrary amplitude responses, 

712 

computational complexity, 683 
cubic interpolation search, 
687-689 

design of filters with even length 
and antisymmetrical impulse 
response, 706 

design of filters with even length 
and symmetrical impulse 
response, 705-706 
design of filters with odd length 
and antisymmetrical impulse 
response, 703-705 
design of filters with odd length 
and symmetrical impulse 
response, 674-678 
design of multiband filters, 
712-713 

efficient Remez exchange 
algorithm, 691-693 
error function, 681 
exhaustive step-by-step search, 

680 

extremals, 678 


impulse response, odd filter 
length, antisymmetrical, 705 
impulse response, odd filter 
length, symmetrical, 683 
initialization of extremals, 679 
interior band edge, 680 
introduction to, 673-674 
Lagrange barycentric interpolation 
formula, 681 

maxima of the error function, 679 
minimum filter length, 700-701 
potential extremals, 678 
prescribed specifications, 700-701 
problem formulation, 674-678 
quadratic interpolation search, 689 
rejection of superfluous potential 
extremals, 682-683 
Remez exchange algorithm, 
678-679 

selective step-by-step search, 
683-687 

use of weighting, 674 
weighted-Chebyshev method, 
673-674 

peak-to-peak passband ripple, 444 
phase delay (absolute) in, 426 
scaling of impulse response, 442 
two-dimensional, 875 
with antisymmetrical impulse 
response, 427 

with symmetrical impulse response, 
427 

zero-pole plot of constant-delay 
filters, 431 

Nontouching loops in signal flow 
graphs, 154 

Nonuniform variable sampling 
technique, 741-743 
virtual sample points, 742 
Normalization of amplitude response in 
nonrecursive filters, 442 
Normalization of numbers in computer 
arithmetic, 624 
Normalized 

approximations, 475 
sensitivity, 632 

transfer functions, see Butterworth, 
Chebyshev, inverse-Chebyshev, 
elliptic, or Bessel-Thomson 
approximation 
Notation 

for continuous-time random 
processes, 598 
for DFT, 358 


for the representation of 
discrete-time signals, 7 
in terms of operators, see Operator 
notation 

Notation for continuous-time random 
processes, 599 

Notch CGIC second-order section, 

816 

Notch transfer function 
discrete-time 

second-order, 250 
ALport network (or Af-port), 775 
nth central moment of a random 
variable, 596 

nth moment of a random variable, 596 
nth-order pole in a rational algebraic 
function, 909 

nth-order zero at infinity, 908 
nth-order zero in a rational algebraic 
function, 908 

nth partial sum of a series, 911 
nth power of a complex number, 897 
nth remainder of a series, 911 
nth root of a complex number, 895 
Number quantization, 625-627 
quantization error, 625 
by rounding, 625 
by truncation, 625 
Number representation: 

binary number system, 618-625 
bias in floating-point number 
representation, 624 
binary point, 618 
bits, 618 

conversion from binary to decimal 
numbers, 619 

conversion from decimal to binary 
numbers, 619 
end-around carry, 622 
exponent, 624 
IEEE Floating-point 
representation, 624 
mantissa, 624 
number normalization in 
floating-point arithmetic, 624 
number quantization, 625-627 
one’s complement, 621 
one’s complement of a negative 
number, 621 
quantization error, 625 
radix, 618 
radix point, 618 
rounding, 625 
sign bit, 621 
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signed-magnitude, 621 
significand, 624 
truncation, 625 
two’s complement, 621-622 
two’s complement of negative 
number, 622 
word length, 621 
Numerical-analysis formulas, 

453^155 

for differentiation, 455 
Gregory-Newton formulas for 
interpolation, 454 
for integration, 455 
for interpolation, 454 
Stirling formula for interpolation, 
454 

Nyquist frequency, 120, 228 
Nyquist, H., 294 

Objective function for 

least-/7th minimax algorithm, 739 
recursive equalizers, 756 
recursive filters, 721, 745 
Observability gramian, 648 
One’s complement: 
addition, 622 
multiplication, 622 
of a negative number, 621 
number representation, 621 
Open annulus in Laurent theorem, 915 
Operation of 

QMF banks, 840-844 
upsampler and interpolator, 833-838 
Operator notation: 
for DFT, 322 

for discrete-time systems, 132 
for Fourier transform, 50 
for Laplace transform, 466 
for z transform, 86 
Oppenheim, A., 674 
Optimization: 

digital differentiators: 
first derivative, 708 
ideal frequency response, 707 
minimum differentiator length, 
708-709 

prescribed specifications, 708 
problem formulation, 707-708 
nonrecursive filters: 
adjustable bracket, 689 
alternation theorem, 677-678 
alternative rejection scheme for 
superfluous potential extremals, 
682 


arbitrary amplitude responses, 712 
computational complexity, 683 
cubic interpolation search, 
687-689 

design of filters with even length 
and antisymmetrical impulse 
response, 706 

design of filters with even length 
and symmetrical impulse 
response, 705-706 
design of filters with odd length 
and antisymmetrical impulse 
response, 703-705 
design of filters with odd length 
and symmetrical impulse 
response, 674-678 
design of multiband filters, 
712-713 

efficient Remez exchange 
algorithm, 691-693 
error function, 681 
exhaustive step-by-step search, 

680 

extremals, 678 
impulse response, odd filter 
length, antisymmetrical, 705 
impulse response, odd filter 
length, symmetrical, 683 
initialization of extremals, 679 
interior band edge, 680 
introduction to, 673-674 
Lagrange barycentric interpolation 
formula, 681 

maxima of the error function, 679 
minimum filter length, 700-701 
potential extremals, 678 
prescribed specifications, 700-701 
problem formulation, 674-678 
quadratic interpolation search, 689 
rejection of superfluous potential 
extremals, 682-683 
Remez exchange algorithm, 
678-679 

selective step-by-step search, 
683-687 

use of weighting, 674 
weighted-Chebyshev method, 
673-674 

recursive equalizers: 
algorithm, 757-758 
design, 753-759 
error function, 756 
examples, 759-765 
feasible stability region, 755 


gradient vector, 756 
group delay of equalizer, 754 
group delay of filter, 754 
objective function, 756 
problem formulation, 753-756 
stability conditions, 755 
transfer function, 754 
recursive filters: 

alternative Newton algorithm, 
727-728 

approximation error, 720 
BFGS updating formulas for 
inverse Hessian, 730 
Charalambous minimax 
algorithm, 740-741 
convex functions, 722 
descent direction, 724 
design, 745-748 

DFP updating formulas for inverse 
Hessian, 730 

duality principle in optimization 
theory, 736 

error function, 720, 745 
Euclidean norm, 722 
Euclidean space, 724 
extrapolation, 733 
Fletcher inexact line search, 733 
global minimum, 725 
gradient vector, 723, 746 
Hessian matrix, 723 
inexact line searches, 730-734 
interpolation, 733 
introduction to, 719 
L\ norm, 721 
Li norm, 722 

least-/?th minimax algorithm, 

739 

least-squares solution, 722 

line searches, 724 

linearly independent vectors, 727 

local minima, 725 

L p norm, 721 

Lqo norm, 722 

minimax algorithms, 738-745 
minimax solution, 722 
minimum filter order, 746 
minimum point, 724 
negative definite Hessian, 725 
Newton algorithm, 724 
Newton direction, 724 
nonquadratic functions, 724 
Ath-order transfer function, 720 
objective function, 721, 745 
positive definite Hessian, 725 
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Optimization ( Cont .): 
recursive filters {Cont.): 

practical quasi-Newton algorithm, 
734-735 

problem formulation, 720-722 
quadratic functions, 722 
quasi-Newton algorithm, 729 
stability, 746 
stationary point, 723 
sum of the squares, 722 
Taylor series, 723 
termination tolerances, 725 
unconstrained algorithms, 722 
unimodal functions, 730 
updating formulas for inverse 
Hessian, 729-730 
use of weighting, 747-748 
virtual sample points, 742 
Optimum word length, 628 
Order of 

nonrecursive discrete-time systems, 
140 

recursive discrete-time systems, 141 
a two-dimensional filter, 875 
Ordering of filter sections in cascade 
realization, 647 

Outermost annulus of convergence, 85 
Output noise in cascade wave 
realization, 818-819 
Overflow 

in digital filters, 640 
limit cycles, 659-660 
elimination of, 665-666 
example, 660 
forced response, 666 
stability of the forced response, 
666 

in one’s- or two’s-complement 
addition, 623 

Overlap-and-add method, 377-380 
Overlap-and-save method, 380-382 

Pal, R. N., 637 
Papoulis, A., 50, 278 
Parallel realization method, 407 
example, 408-409 
Parallelogram law in complex 
arithmetic, 897 
Parhami, B., 625 
Parks, T. W., 674 
Parseval de Chenes, M. A., 37 
Parseval’s formula: 

for discrete-time signals, 94 
for nonperiodic signals, 62 


for normalized discrete-time signals, 
95 

for periodic signals, 37 
in signal scaling, 644 
Partial fractions, 115-116 
Pascal triangle, 914 
Passband edge in practical analog 
filters, 473 

Passband in analog filters, 472 
Passive RLC filters, 15 
Peak-to-peak passband ripple 
in nonrecursive filters, 444 
Peek, J. B. H., 666 
Peled, A., 21 

Perfect reconstruction in QMF banks, 
849-851 

Period in periodic signals, 30 
Period parallelograms in elliptic 
functions, 933 

Periodic continuation, 30 , 294, 328 
Periodic convolutions, 358-362 
frequency-domain, 361 
time-domain, 359 
example, 359-361 
graphical representation, 359-361 
Periodic functions of a complex 
variable, 904-905 
Periodic signals: 

amplitude spectrum, 5, 34 
discrete window functions, 353 
example, 354 
Fourier transform of, 274 
frequency spectrum, 34 
fundamental, 34 
harmonics, 34 
period of, 30 
periodic continuation, 30 
periodic discrete window functions, 
352 

phase spectrum, 5, 34 
pitfalls associated with the Fourier 
transforms of, 272 
spectral representation, 5 
Periodicity 
ofDFT, 323 

of elliptic functions, 932-934 
of frequency response, 229 
of frequency spectrum 

of discrete-time signals, 120 
of impulse-modulated signals, 291 
Phase (absolute) delay 
in nonrecursive filters, 426 
Phase distortion in discrete-time 
systems, 253 


Phase response: 
ambiguity, 232 
correction, 234—235 
in discrete-time systems of arbitrary 
order, 226 

in first-order discrete-time systems, 
161 

graphical evaluation, 227-228 
influence of warping effect, 548 
in two-dimensional digital filters, 

877 

Phase shift, 160, 226 
in analog filters, 470 
Phase spectrum: 
in DFT, 322 

discrete-time signals, 119 
nonperiodic signals, 50 
periodic signals, 5, 34 
Pipelining, 413 
Pitfalls 

associated with 

the definition of an impulse 
function, 263-265 
the Fourier transforms of periodic 
signals, 272 

in general inversion method of z 
transform, 101-102 
in the use of partial fractions, 118 
Plots of elliptic functions, 928 
Poisson’s summation formula, 284-286 
Polar representation of complex 
numbers, 894 
Pole at infinity, 909 
Poles 

of discrete-time transfer function, 

203 

of z transform, 80 
Polynomials of a complex variable, 

899 

Port conductance, 783 
Port resistance, 775 
Positive definite matrix, 217 
Potential extremals in nonrecursive 
filters, 678 

Power density spectrum of a 

continuous-time random 
process, 605 

Power in a discrete-time random 
process, 610 
Power series, 912 
Power spectral density (PSD) of 
a noise source, 638 
output in a canonic section, 640 
a random process, 605 
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Practical filters: 
bandpass, 473^-74 
bandstop, 473^-74 
highpass, 473 
lowpass, 473 

maximum passband loss, 473 
minimum stopband loss, 473 
passband edge, 473 
stopband edge, 473 
Practical quasi-Newton algorithm, 
734-735 

example, 736-738 
Prescribed specifications: 
in digital differentiators by 
optimization, 708 
example, 710-712 
in nonrecursive filters by 
optimization, 700-701 
example, 701-703 
nonrecursive filters: 
bandpass, 450 
bandstop, 450 

example, 448-449, 451^-53 
highpass, 450 
lowpass, 445^147 
recursive filters: 

amplitude equalization, 588 
analog-filter transformations, 

565 

bandpass filters, 568-573 
bandstop filters, 573 
Butterworth filters, 573-574 
Chebyshev filters, 575-576 
constant-delay, 586-587 
delay equalization, 586-587 
design formulas for lowpass and 
highpass filters, 568 
design procedure, 564-565 
design using formulas and tables, 
577-578 

elliptic filters, 576-577 
examples, 578-585 
highpass filters, 568 
introduction to the design of 
recursive filters satisfying 
prescribed specifications, 
563-564 

inverse Chebyshev filters, 576 
lowpass filters, 565-568 
zero-phase (zero-delay) filters, 
587-588 

wave digital filters, 802 
example, 802-805 
Prewarping technique, 546 


Principal angle of a function of a 
complex variable, 904 
Principal minor determinants (minors), 
725 

of an N x N matrix, 217 
Principal part of a Laurent series, 

916 

Probability-density function 
definition, 594 
Gaussian, 594 
Rayleigh, 614 
uniform, 594 

Probability-distribution function 
definition, 594 

Problem formulation for the design of 
digital differentiators, 707-708 
nonrecursive filters by optimization, 
674-678 

bandpass, 676-677 
bandstop, 677 
highpass, 675-676 
lowpass, 675 

recursive equalizers by optimization, 
753-756 

recursive filters by optimization, 
720-722 

Processing elements, 412 
Processing of continuous-time signals 
by using digital filters, 298-301 
example, 301-303 

Processing rate in systolic structures, 
413 

Product quantization, 638-640 
noise model for 

a multiplier, 638-639 
second-order canonic section, 639 
output PSD in canonic section, 640 
PSD of a noise source, 638 
signal scaling based on L p norm, 
641-643 

white-noise process, 638 
Propagation delay, 143 
of adder, 147 
of multiplier, 147 
of unit delay, 147 
Properties of 

discrete-time systems, see 
Discrete-time systems 
Fourier transform, see Fourier 
transform 

z transform, see z transform 
Proportionality condition in 

discrete-time systems, 133 
PSD, see Power spectral density 


Pseudopower in wave digital filters, 

808 

QMF, see Quadrature-mirror-image 
filter bank 

Quadratic form in matrices, 217 
Quadratic functions, 722 
Quadratic interpolation search in 

Remez exchange algorithm, 689 
Quadrature-mirror-image filter (QMF) 
banks: 

aliasing in, 841 

amplitude and phase distortion in, 
841 

analysis section, 840 
application to 

frequency-division to 
time-division multiplex 
translation, 887 
time-division to 

frequency-division multiplex 
translation, 886 
decomposition section, 840 
design of, 846-848 
elimination of aliasing in, 844-846 
frequency response in, 847 
introduction to, 839-840 
operation, 840-844 
perfect reconstruction, 849-851 
reconstruction section, 840 
synthesis section, 840 
Quantization error, 625 

introduced by rounding, 626 
introduced by truncation 

in one’s- or two’s- complement 
numbers, 626 

in signed-magnitude numbers, 626 
Quantization errors 
in A/D converters, 305 
introduction to, 390 
Quantization (granularity) limit cycles, 
654-659 

constant-input limit cycles, 664 
elimination of, 664 
deadband effect, 654 
deadband range, 656 
elimination of, 660-663 
in first-order section, 654 
frequency of limit cycle, 656 
in second-order section, 656 
Quantized signals, 3 
Quantizer, 4, 627 

transfer characteristic, 627 
Quasi-Newton algorithm, 729 
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Rabiner, L. R., 674, 701 
Radius of convergence, 82 
of a power series, 914 
Radix, 618 
Radix point, 618 

Raleigh probability-density function, 
614 

Ramana Rao, Y. V., 637 
Random processes: 
continuous-time: 

autocorrelation function, 602 
definition, 598 
ensemble, 598 
examples, 600-602 
first-order statistics, 599 
frequency-domain representation, 
604-608 

&th-order statistics, 600 
notation, 598-599 
power density spectrum, 605 
power spectral density (PSD), 605 
relation between the Fourier 
transform of the autocorrelation 
function and the power density 
spectrum, 606-608 
sample function, 598 
second-order statistics, 600 
strictly stationary processes, 604 
wide-sense stationary processes, 
604 

Wiener-Khinchine relation, 608 
discrete-time: 

autocorrelation, 609 
filtering of, 610-611 
frequency-domain representation, 
609-610 
mean, 609 
mean square, 609 
power in, 610 

relation between the z transform 
of the autocorrelation function 
and the power density spectrum, 
609-610 

introduction to, 593 

Random signals, see Random processes 
Random variables: 
definition, 593 
example, 597-598 
expected value of 

a random variable, 595 
a random variable that depends on 
two or more variables, 596 
joint distribution function 
definition, 594-595 


joint probability-density function 
definition, 595 

mean square (second moment) of a 
random variable, 596 
n\h central moment of a random 
variable, 596 

n\h moment of a random variable, 
596 

probability-density function 
definition, 594 
Gaussian, 594 
Rayleigh, 614 
uniform, 594 

probability-distribution function 
definition, 594 
statistical independence, 595 
variance (second central moment) of 
a random variable, 596 
Ratio of products of complex numbers, 
896 

Ratio test for the convergence of a 
series, 912 

Rational algebraic functions of a 
complex variable, 

905-906 

Rational functions, 80 
Reachability gramian, 648 
Real-convolution integral derived from 
complex convolution, 93 
Real-convolution theorem of z 
transform, 88 

Real part of a complex number, 892 
Realizability constraints 
for continuous-time transfer 
functions, 474 

for discrete-time transfer functions, 
530 

for wave digital filters, 791 
Realization: 
canonic, 395 

of cascade wave digital filters, see 
Cascade wave digital filters 
choice of realization, 819-820 
introduction to, 390 
of Meerkotter, 663-664 
methods: 

cascade, 404^-06 
direct, 390, 392-393 
direct canonic, 395-396 
indirect, 390 
lattice, 401^-04 
parallel, 407 
state-space, 397-399 
using transposition, 410 


of wave digital filters, see Wave 
digital filters 

Reconstruction section of a QMF bank, 
840 

Rectangular window function 
continuous-time, 337 

frequency spectrum of, 338 
ripple ratio in, 339 
discrete-time, 350 , 435 
frequency spectrum of, 350 , 435 
ripple ratio in, 339 , 435 
transition width in, 435 
z transform of, 350 

Recursive discrete-time systems, see 
Discrete-time systems: 
recursive 

Recursive equalizers: 
by optimization: 
algorithm, 757-758 
design, 753-759 
error function, 756 
feasible stability region, 755 
gradient vector, 756 
group delay of equalizer, 754 
group delay of filter, 754 
objective function, 756 
problem formulation, 753-756 
stability conditions, 755 
transfer function, 754 

Recursive filters: 
adaptive, 871-872 
bilinear-transformation method, 
541-545 

derivation of, 541-543 
design formulas, 548 
mapping properties, 543-545 
prewarping technique, 546 
warping effect, 545-548 
comparisons with nonrecursive 
filters, 554 

introduction to the approximation 
problem for recursive filters, 
529 

invariant impulse-response method, 
530-532 

merits and demerits, 532 
invariant sinusoid-response method, 
558 

invariant unit-step-response method, 
557 

matched-z transformation method, 
538-539 

correction of multiplier constant, 
539 
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merits and demerits, 539 
modified invariant impulse-response 
method, 534—535 
merits and demerits, 535 
stabilization technique, 535 
by optimization: 

alternative Newton algorithm, 
727-728 

approximation error, 720 
BFGS updating formula for 
inverse Hessian, 730 
Charalambous minimax 
algorithm, 740-741 
convex functions, 722 
descent direction, 724 
design, 745-748 

DFP updating formula for inverse 
Hessian, 730 

duality principle in optimization 
theory, 736 

equalization, see Recursive 
equalizers: by optimization 
error function, 720 , 745 
Euclidean norm, 722 
Euclidean space, 724 
examples, 748-753 
extrapolation, 733 
Fletcher inexact line search, 

733 

global minimum, 725 
gradient vector, 723 , 746 
Hessian matrix, 723 
inexact line searches, 730-734 
interpolation, 733 
introduction to, 719 
L\ norm, 721 
L 2 norm, 722 

least-pth minimax algorithm, 739 

least-squares solution, 722 

line searches, 724 

linearly independent vectors, 727 

local minima, 725 

L p norm, 721 

Loo norm, 722 

minimax algorithms, 738-745 
minimax solution, 722 
minimum filter order, 746 
minimum point, 724 
negative definite Hessian, 725 
Newton algorithm, 724 
Newton direction, 724 
nonquadratic functions, 724 
nonuniform variable sampling 
technique, 741-743 


Nth-order transfer function, 720 
objective function, 721 , 745 
positive definite Hessian, 725 
practical quasi-Newton algorithm, 
734-735 

problem formulation, 720-722 
quadratic functions, 722 
quasi-Newton algorithm, 729 
stability, 746 
stationary point, 723 
sum of the squares, 722 
Taylor series, 723 
termination tolerances, 725 
unconstrained algorithms, 722 
unimodal functions, 730 
updating formulas for inverse 
Hessian, 729-730 
use of weighting, 747-748 
virtual sample points, 742 
prescribed specifications: 
amplitude equalization, 588 
analog-filter transformations, 

565 

bandpass filters, 568-573 
bandstop filters, 573 
Butterworth filters, 573-574 
Chebyshev filters, 575-576 
constant-delay, 586-587 
delay equalization, 586-587 
design formulas for lowpass and 
highpass filters, 568 
design procedure, 564-565 
design using formulas and tables, 
577-578 

elliptic filters, 576-577 
examples, 578-585 
highpass filters, 568 
introduction to the design of 
recursive filters satisfying 
prescribed specifications, 
563-564 

inverse Chebyshev filters, 576 
lowpass filters, 565-568 
zero-phase (zero-delay) filters, 
587-588 
transformations: 
application, 554 
general, 549-551 
lowpass-to-bandpass, 553 
lowpass-to-bandstop, 552-553 
lowpass-to-highpass, 553 
lowpass-to-lowpass, 551-552 
mapping properties, 550 
table, 553 


two-dimensional, 874 
Reflected wave quantity, 775 
Region of convergence of a power 
series, 913 
Register, 619 

Regular functions in complex analysis, 
907 

Rejection of superfluous potential 
extremals, 682-683 
Relation between 

the Fourier transform of the 

autocorrelation function and the 
power density spectrum of a 
random process, 606-608 
the sum of the magnitudes and the 
magnitude of the sum of a set of 
complex numbers, 897 
transfer function and impulse 
response, 202 

the z transform of the autocorrelation 
function and the power density 
spectrum of a random process, 
609-610 

Relatively prime polynomials, 207 
Relaxed discrete-time systems, 134 
Remez exchange algorithm: 
alternative rejection scheme for 

superfluous potential extremals, 
682 

computational complexity, 683 
cubic interpolation search, 687-689 
design of digital differentiators: 
first derivative, 708 
ideal frequency response, 707 
minimum differentiator length, 
708-709 

prescribed specifications, 708 
problem formulation, 707-708 
efficient implementation, 691-693 
error function, 681 
examples, 696-700 
extremals, 678 

gradient information, 694-696 
improved formulation for Remez 
exchange algorithm, 689-691 
initialization of extremals, 679 
interior band edge, 680 
maxima of the error function, 679 
potential extremals, 678 
quadratic interpolation search, 689 
rejection of superfluous potential 
extremals, 682-683 
selective step-by-step search, 
683-687 
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Replacement of several self loops by a 
single self loop in signal flow 
graphs, 150 
Representation of 
transfer functions 

by zero-pole plots, 203 
two-dimensional digital filters by 
a difference equation, 874 
the 2-D convolution, 875 
a 2-D transfer function, 875 
z transform 

by rational functions, 80 
by zero-pole plots, 80 
Residue, 86 
Residue of a pole, 917 
Residue theorem, 86, 919 
Resonant circuits in analog LC filters, 
788-791 

Response (output) in discrete-time 
systems, 132 
Rhodes, J. D., 794 
Riemann, R. B., 898 
Riemann-Lebesque lemma, 267 
Riemann sphere, 898 
Riemann surface of a function, 

903-904 

Right-sided signals, 53 
Ripple ratio: 

in Blackman window, 439 
in continuous-time window 
functions, 338 

in Dolph-Chebyshev window, 

440 

in Hamming window, 438 
in Kaiser window, 348, 445 
in rectangular window, 339, 435 
trade-off with main-lobe width in the 
design of nonrecursive filters, 
439 

in von Hann window, 438 
Roberts, R. A., 647, 661 
Rosenbrock function, 767 
Rounding, 625 
Rounding error, 626 
Roundoff noise 

minimization, 647-650 
Rule of correspondence in 

discrete-time systems, 132 

.s' 2 -impedance elements, 802 
Saal, R., 802 

Sample-and-hold device, 303 
Sample function in continuous-time 
random processes, 598 


Sampler, 4 

Sampling frequency, 3 
Sampling-frequency conversion: 
compression, 831 
compressor, 831 
decimators, 830-833 
downsampler, 831 
downsampling, 831 
expander, 833 

images produced by upsampling, 834 
interpolators, 833-838 
introduction to, 830 
by a noninteger factor, 839 
operation of upsampler and 
interpolator, 833-838 
upsampler, 833 

Sampling of bandpassed signals, 
861-862 

Sampling period, 3 
Sampling process 

introduction to, 261-262 
Sampling theorem 
frequency-domain, 328-333 
introduction to, 125 
time-domain, 294-296 
Sandberg, I. W., 661 
Saramaki window, 453 
Scaling 

in digital-filter structures, see Signal 
scaling 

Scaling of impulse response in 
nonrecursive filters, 442 
Schur polynomials, 217 
Schur-Cohn stability criterion, 

216-217 

Schur-Cohn-Fujiwara 

simplified stability criterion, 219 
stability criterion, 217-218 
example, 218-219 
Schwarz inequality, 642 
Second-order statistics in 

continuous-time random 
processes, 600 

Section-optimal structures, 649 
Sedlmeyer, A., 773 
Selective step-by-step search, 

683-687 
Selectivity factor 
elliptic approximation, 497 
Sensitivity 

of the amplitude response, 629 
normalized, 632 
of the phase response, 631 
Sensitivity considerations 


in analog filters, 774—775 
in wave digital filters, 774-775 
Separable transfer functions in 

two-dimensional digital filters, 
881 

Series of complex numbers, 911 
Series representation of elliptic 
functions, 936-937 
Shannon, C. E., 20, 294 
Shift operator: 
definition, 143 
inverse shift operator, 143 
law of exponents, 143 
linearity of, 143 
Sidebands, 294 
Siegel, J., 674 
Sign bit, 621 
Signal flow graphs: 
adjoint, 410 
analysis by using 

Mason’s method, 153-154 
the node-elimination method, 
148-153 
butterfly, 363 
direct paths in, 154 
directed branches in, 147 
distribution nodes in, 147 
elimination of 

nodes with multiple incoming and 
multiple outgoing branches, 149 
parallel branches, 149 
self loops, 150 
series branches, 148 
example, 150-152 
graph determinant, 154 
loop transmittances in, 154 
Mason’s gain formula, 153 
nontouching loops in, 154 
replacement of several self loops by 
a single self loop, 150 
subgraph determinants in, 154 
subgraphs in, 154 
transmittances in, 147 
transpose, 410 
transposition theorem, 410 
Signal scaling, 640-647 

application to cascade realization, 
645 
based on 

L 2 norm, 643 
L p norm, 641-643 
Lqo norm, 643 

in cascade wave realization, 817-818 
L 2 versus Loo scaling, 643-645 
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ordering of filter sections, 647 
overflow in digital filters, 640 
use of Holder inequality in, 642 
use of Parseval’s formula in, 644 
use of Schwarz inequality in, 642 
in wave digital filters, 807-808 
Signals: 
analog, 3 
analytic, 852 
bandpassed, 861 
continuous-time, see 

Continuous-time signals 
DFT of complex signals, 383 
digital, 3 

discrete-time, see Discrete-time 
signals 

impulse-modulated, 286-288 
man-made, 1 
natural, 2 

nonperiodic, see Nonperiodic signals 
nonquantized, 3 
periodic, see Periodic signals 
quantized, 3 
right-sided, 53 
sine function, 266 
two-dimensional, 2, 874 
two-sided, 90 
unity function, 271 
Signed-magnitude 
addition, 622 
arithmetic, 620 
multiplication, 622 
number representation, 621 
Significand in number representation, 
624 

Simple poles in a rational algebraic 
function, 909 

Simple zeros in a rational algebraic 
function, 908 

Simpson’s one-third rule, 344 
Sine distortion, 307 
reduction in, 308 
Sine function, 266 

Single-sideband modulation, 859-861 
Singularities (singular points) in a 

rational algebraic function, 908 
Sinusoidal response of 
analog filters, 470 
discrete-time systems 
first-order, 159-160 
Nth-order, 224-226 
Skwirzynski, J. K., 802 
Smith, M. J. T., 849 
Smoothing device, 4 


Software digital filters, 22 
Software implementation, 391 

by using the FFT approach, 376-377 
Specification constraint in elliptic 
filters, 508-509 

Spectral energy in continuous-time 
signals, 337 

Spectral interrelation between discrete- 
and continuous-time signals, 
290-292 

example, 292-293 
Spectral representation 
of discrete-time signals, 119 
of nonperiodic signals, 50 
of periodic signals, 5, 34 
Spectrum, see Frequency, Amplitude, 
or Phase spectrum 
Spherical representation of complex 
numbers, 898 

Square-root of a complex variable, 902 
Stability: 

analysis, 207-210 
bounded-input, bounded-output 
(BIBO), 172 
constraint 

on eigenvalues, 211 
on impulse response, 172 
on poles, 210 
criteria (tests): 

Jury-Marden, 219-220 
Lyapunov, 222-223 
Schur-Cohn, 216-217 
Schur-Cohn-Fujiwara, 217-218 
Schur-Cohn-Fujiwara criterion 
simplified, 219 
example, 173-174 
feasible region for recursive filters 
and equalizers, 755 
of the forced response, 666 
impulse response 

of Nth-order systems, 207-208 
introduction to, 207 
Jury-Marden array, 219 
Lyapunov equation, 222 
necessary and sufficient condition 
for, 172 

in nonrecursive systems, 173, 210 
relatively prime polynomials, 207 
stabilization technique for recursive 
filters, 535 

in steepest-descent algorithm, 870 
test for common factors, 215 
in two-dimensional digital filters, 

876 


Stabilization technique for recursive 
filters, 535 

Standard Fourier transforms, 275 
Standard z transforms, 100 
State variables, 176 
State-space characterization, 176-178 
examples, 179-185 
time-domain analysis, 184-185 
example, 185 
impulse response, 185 
response to arbitrary excitation, 
184 

unit-step response, 185 
State-space method 
applications of, 186 
State-space realization method, 
397-399 

example, 399-400 
Stationary point, 723 
Statistical independence in random 
variables, 595 
Statistical word length, 630 
Steady-state 
component, 160 
sinusoidal response, 160 

of N-order systems, 224-226 
value of unit-step response in a 
first-order system, 157 
Steepest-descent algorithm in adaptive 
filters, 867-868 
example, 868-870 
stability in, 870 

Stirling interpolation formula, 454 
Stirling, J., 20 

Stopband edge in practical analog 
filters, 473 

Stopband in analog filters, 472 
Stored power in wave digital filters, 808 
Strictly stationary continuous-time 
processes, 604 
Structures: 

block-optimal, 649 
canonic, 395 
cascade, 404^1-06 
cascade wave structures, see Wave 
digital filters: cascade wave 
realization 

choice of structure, 819-820 
direct, 392-393 
direct canonic, 395-396 
elimination of quantization limit 
cycles in, 660-663 
lattice, 401^-04 
low-sensitivity, 632-637 
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Structures ( Cont .): 

Meerkotter’s realization, 663-664 
parallel, 407 
section-optimal, 649 
state-space, 397-399 

minimization of roundoff noise, 
647-649 

systolic, 412^-16 
transpose, 410 

wave structures, see Wave digital 
filters 

Subgraph determinants in signal flow 
graphs, 154 

Subgraphs in signal flow graphs, 154 
Subtraction in complex arithmetic, 894 
Sum of 

a geometric series, 913 
a series, 911 
the squares, 722 
Superposition condition in 

discrete-time systems, 133 
Switched-capacitor filters, 15 
Symmetrical impulse response in 
nonrecursive filters, 427 
Symmetry of DFT, 323-324 
Symmetry theorem of Fourier 
transform, 58 

Synthesis section of a QMF bank, 

840 

Systolic structures, 412-416 
Tables: 

analog-filter transformations, 518 , 
565 

Constantinides transformations, 553 
design formulas for the design of 
bandpass and bandstop filters 
satisfying prescribed 
specifications, 573 
Butterworth filters satisfying 
prescribed specifications, 574 
Chebyshev filters satisfying 
prescribed specifications, 575 
elliptic filters satisfying prescribed 
specifications, 577 
lowpass and highpass filters 
satisfying prescribed 
specifications, 568 
elementary discrete-time signals, 95 
elements of discrete-time systems, 
142 

formulas for frequency response of 
nonrecursive filters, 430 
impulse and unity functions, 269 


standard Fourier transforms, 72, 275 
standard z transforms, 100 
summary of window parameters, 437 
Taylor, B., 20 
Taylor, M. G., 660 
Taylor series, 475, 723 
Termination tolerances, 725 
Test for 

causality in discrete-time systems, 
136-137 

examples, 137-139 
common factors, 215 
linearity in discrete-time systems, 
132-133 

example, 133-134 
stability 

Jury-Marden, 219-220 
Schur-Cohn, 216-217 
Schur-Cohn-Fujiwara, 217-218 
time-invariance in discrete-time 
systems, 134 
example, 135-136 
Theorems: 

absolute convergence of a series, 912 
alternation theorem, 677-678 
convergence of a series, 912 
De Moivre’s theorem, 894-895 
Fourier series: 
convergence, 36 
kernel, 278 

least-squares approximation, 38 
Parseval’s formula, 37 
uniqueness, 39 
Fourier transform: 
convergence, 58 
frequency convolution, 62 
frequency differentiation, 60 
frequency shifting, 60 
linearity, 58 
moments, 60 
Parseval’s formula, 62 
symmetry, 58 
time convolution, 61 
time differentiation, 60 
time scaling, 59 
time shifting, 60 
frequency-domain periodic 
convolution, 362 
interrelation between the Fourier 
series and the Fourier 
transform, 280-281 
properties of 

frequency-domain impulse 
functions, 272 


time-domain impulse functions, 
269 

ratio test for the convergence of a 
series, 912 
residue theorem, 919 
sampling theorem 

frequency-domain, 328-333 
time-domain, 294-296 
time-domain periodic convolution, 
361 

transposition in signal flow graphs, 
410 

z transform: 

absolute convergence, 81 
complex convolution theorem, 91 
complex differentiation theorem, 
87 

complex scale change theorem, 87 
final-value theorem, 90 
initial-value theorem, 89 
linearity, 86 
Parseval’s formula, 94 
Parseval’s formula for normalized 
discrete-time signals, 95 
real convolution theorem, 88 
time shifting, 87 
uniform convergence, 82 
Theta functions, 937 
Thomson, W. E., 514 
Time 

denormalization, 7 
invariance in discrete-time systems, 
134 

normalization, 7 

Time-convolution theorem of Fourier 
transform, 61 

Time-dependent discrete-time systems, 
134 

Time-differentiation theorem of Fourier 
transform, 60 
Time-domain 
aliasing, 333, 335 
impulse function, 265 
periodic convolution, 359 

graphical representation, 359-361 
theorem, 361 
unity function, 271 
Time-domain analysis: 
examples, 155-161 
of higher-order systems 

using mathematical induction, 
162-163 

impulse response of first-order 
systems, 155-156 
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introduction to, 155 
steady-state component, 160 
steady-state sinusoidal response, 

160 

transient component, 160 
unit-step response of first-order 
systems, 156-158 
using convolution summation, 
166-169 

using mathematical induction, 
155-163 

using state-space characterization, 
184-185 

using the z transform, 223 
example, 223-224 
Time-domain representation of 
periodic signals, 5 
Time-domain response: 
of analog filters 

to an arbitrary excitation, 467 
to an impulse, 469 
to a sinusoidal excitation, 469 
to a unit step, 469 
of first-order discrete-time systems 
to an exponential excitation, 
158-159 

to an impulse, 155-156 
to a sinusoidal excitation, 159-160 
to a unit step, 156-158 
of Nth-order discrete-time systems 
to an impulse, 163 
to a sinusoidal excitation, 224-226 
using state-space characterization 
to an arbitrary excitation, 184 
to an impulse, 185 
to a unit-step, 185 

Time-invariant discrete-time systems, 
134 

Time-scaling theorem of Fourier 
transform, 59 
Time-shifting theorem 

of the Fourier transform, 60 
of the z transform, 87 
Transfer characteristic of 

fixed-point adder incorporating 
saturation mechanism, 659 
one’s or two’s complement 
fixed-point adder, 659 
a quantizer, 627 
Transfer functions: 

Bessel-Thomson, see 

Bessel-Thomson approximation 
Butterworth, see Butterworth 
approximation 


Chebyshev, see Chebyshev 
approximation 
continuous-time: 
allpass, 524 
definition, 466 
denormalized, 475 
normalized, 475 
realizability constraints, 474 
relation with impulse response, 
467 

representation by zeros and poles, 
466 

for digital filters, 245-251 
discrete-time: 

of causal, linear, time-invariant 
system, 203 
definition, 202 
derivation from difference 
equation, 202-203 
derivation from state-space 
characterization, 205 
derivation from system network, 
204 

example, 206-207 
first-order, 246 
first-order allpass, 246 
high-order, 251 
high-order allpass, 587 
of nonrecursive system, 203 
order of, 203 

realizability constraints, 530 
relation with impulse response, 
202 

representation by a zero-pole plot, 
203 

second-order allpass, 251 
second-order bandpass, 249 
second-order highpass, 248 
second-order lowpass, 246-247 
second-order notch, 250 
elliptic, see Elliptic approximation 
of equalizers, 754 
of impulse-modulated filter 
continuous-time, 299 
discrete-time, 299 
inverse-Chebyshev, see 
Inverse-Chebyshev 
approximation 
ladder wave structure, 799 
lattice LC network, 793 
lattice wave realization, 797 
Nth-order for recursive filters, 720 
two-dimensional, 875 
separable, 881 


Transformation co = «J~k sn(z, k ), 934 
mapping properties, 934-936 
Transformations for 
analog filters: 

lowpass-to-bandpass, 516 
lowpass-to-bandstop, 519 
lowpass-to-highpass, 519 
lowpass-to-lowpass, 516 
table, 518 
digital filters: 
application, 554 
general, 549-551 
lowpass-to-bandpass, 553 
lowpass-to-bandstop, 552-553 
lowpass-to-highpass, 553 
lowpass-to-lowpass, 551-552 
mapping properties, 550 
table, 553 

Transformers in analog LC filters, 
784-786 
Transforms: 

Fourier transform, see Fourier 
transform 

Laplace transform, see Laplace 
transform 

z transform, see z transform 
Transient component, 160 
Transmittances in signal flow graphs, 
147 

Transpose signal flow graph, 410 
Transposition realization method, 410 
example, 410-411 
Transposition theorem, 410 
Trick, T. N., 661 
Trigonometric functions, 900 
identities, 901 
Truncation, 625 
Truncation error for 

one’s or two’s complement numbers. 
626 

signed-magnitude numbers, 626 
Tukey, J. W., 20, 321 
Turner, L. E., 661, 664 
Two’s complement: 
addition, 622 
multiplication, 622 
of a negative number, 622 
number representation, 621-622 
Two-dimensional convolution, 875 
Two-dimensional digital filters: 
amplitude response, 877 
example, 878-879 
applications of, 881 
approximations, 881 
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Two-dimensional digital filters ( Cont .): 
approximations ( Cont.): 

by singular-value decomposition, 
881 

by using the McClellan 
transformation, 881 
fan, 880 

frequency response, 877 
group delay, 877 
highpass, 880 
introduction to, 874 
lowpass, 880 
nonrecursive, 875 
order, 875 
phase response, 877 
recursive, 874 
representation by 

a difference equation, 874 
the 2-D convolution, 875 
a 2-D transfer function, 875 
stability, 876 
example, 876-877 
types of, 880 

with circular passband and stopband 
boundaries, 880 
with rectangular passband and 
stopband boundaries, 880 
with separable transfer functions, 

881 

Two-dimensional signals, 2, 874 
Two-dimensional transfer function, 875 
Two-dimensional z transform, 875 
Two-sided signals, 90 

Ultraspherical window, 453 
Unconstrained adaptors, 783 
Unconstrained optimization 
algorithms, 722 

Uniform convergence in a power series, 
913 

Uniform convergence of z transform, 

82 

Uniform probability-density function, 
594 

Unimodal functions, 730 
Uniqueness theorem of Fourier series, 
39 

Unit circle of z plane, 119 
Unit delay, 142 

Unit elements in analog LC filters, 
786-788 

characteristic impedance in, 786 
Unit-step function, 274 
continuous-time, 56 


Unit-step response 
in analog filters, 469 
of first-order systems, 156-158 
steady-state value in first-order 
systems, 157 

using convolution summation, 
166-167 

using state-space characterization, 
185 

Unity function 

frequency-domain, 266 
time-domain, 271 

Updating formulas for inverse Hessian 
BFGS formula, 730 
DFP formula, 730 
rank-one formula, 729 
rank-two formula, 729 
Upsampler, 833 

Vaidyanathan, P. P., 661, 810 
Variance (second central moment) of a 
random variable, 596 
Vaughan-Pope, D. A., 811 
Vector representation of complex 
numbers, 897 
Verkroost, G., 664 
Virtual sample points, 742 
VLSI implementation, 412 
Voltage sources in analog LC filters, 
779-781 

von Hann, J., 435 
von Hann window function, 437 
frequency spectrum of, 438 
main-lobe width in, 439 
ripple ratio in, 438 

Warping effect 

in bilinear-transformation method, 
545-548 

influence on amplitude response, 
546 

influence on phase response, 548 
in wave digital filters, 802 
Wave digital filters: 
adaptors: 

parallel 1-multiplier (PI), 783 
parallel 2-multiplier (P2), 783 
series 1-multiplier (SI), 782 
series 2-multiplier (S2), 780 
2-port, 783-784 
cascade wave realization: 
allpass CGIC section, 817 
bandpass CGIC section, 816 
CGIC realization, 811-812 


design procedure, 814-815 
digital G-CGIC configuration, 
812-814 

highpass CGIC section, 815 
lowpass CGIC section, 815 
notch CGIC section, 816 
output noise, 818-819 
power spectral density, 819 
scaling, 817-818 
delay-free loops, 775 
design procedure 

for ladder wave filters, 798-799 
for lattice wave filters, 796-797 
elimination of limit cycles, 808-810 
pseudopower, 808 
stored power, 808 

frequency-domain analysis, 805-807 
introduction to, 773-774 
prescribed specifications, 802 
realizability constraint, 791 
realization of: 

analog elements, 777-778 
circulators, 788 
FDNR networks, 802 
impedances, 778 
LC ladder network, 799 
LC lattice network, 796 
parallel wire interconnections, 
782-783 

related realization methods, 
810-811 

resonant circuits, 788-791 
s 2 -impedance elements, 802 
series wire interconnections, 
780-782 

transformers, 784-786 
unit elements, 786-788 
voltage sources, 779-781 
realization procedure, 777-778 
scaling, 807-808 
transfer function for ladder wave 
structure, 799 

transfer function for lattice wave 
structure, 797 

unconstrained adaptors, 783 
Wave network characterization: 
incident wave quantity, 775 
for V-port network, 775 
port conductance, 783 
port resistance, 775 
reflected wave quantity, 775 
Weighted-Chebyshev method, 

673-674 

Weighting in the design of 
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nonrecursive filters by optimization, 
674 

recursive filters by optimization, 
747-748 

White-noise process, 638 
Wide-sense stationary continuous-time 
random processes, 604 
Wiener filters, 865-867 
Wiener-Khinchine relation, 

608 

Window functions: 
continuous-time, see 

Continuous-time window 
functions 
definition, 337 

design of nonrecursive filters, see 
Nonrecursive filters 
discrete-time, see Discrete-time 
window functions 
periodic discrete-time, 

352-353 
example, 354 
two-sided, 337 

Window length in continuous-time 
window functions, 338 
Window technique 
application, 354-356 
estimation of sampling frequency, 
356 

example, 356-358 
design of nonrecursive filters, see 
Nonrecursive filters 
introduction to, 337 
Wire interconnections in analog LC 
filters 

parallel, 782 
series, 780 
Word length, 621 
optimum, 628 
statistical, 630 


z transform: 

annulus of convergence, 84 
common region of convergence, 91 
conformal transformation 
(mapping), 92 
convergence, 81 

corollary of initial-value theorem, 89 
definition of, 80 

frequency-domain analysis, 224-235 
general inversion method, 85-86 
introduction to, 79 
inverse, 85-86 
inversion techniques: 

use of binomial series, 103 
use of convolution theorem, 108 
use of initial-value theorem, 113 
use of long division, 110-113 
use of partial fractions, 115-116 
using general inversion method, 
85-86 

of Kaiser window function, 351 
as a Laurent series, 83-84 
outermost annulus, 85 
radius of convergence, 82 
of rectangular window, 350 
relation with 
DFT, 325-327 
Fourier transform, 288 
Laplace transform, 291-292 
representation 

by rational functions, 80 
by zero-pole plots, 80 
residue, 86 
residue theorem, 86 
theorems: 

absolute convergence, 81 
complex convolution theorem, 91 
complex differentiation theorem, 
87 

complex scale change theorem, 87 


final-value theorem, 90 
initial-value theorem, 89 
linearity, 86 
Parseval’s formula, 94 
Parseval’s formula for normalized 
discrete-time signals, 95 
real convolution theorem, 88 
time shifting, 87 
uniform convergence, 82 
time-domain analysis, 223 
two-dimensional, 875 
Zero-loss frequencies in elliptic filters, 
502 

Zero padding in DFT, 327-329 
Zero-phase (zero-delay) filters, 
587-588 
Zero-pole plots: 

of constant-delay nonrecursive 
filters, 431 

of continuous-time transfer function, 
472 

of loss function in 
analog filters, 472 
Butterworth filters, 478 
Chebyshev filters, 488 
of a rational algebraic function, 

910 

representation of transfer functions 
by, 203 

Zeros 

of discrete-time transfer function, 
203 

of z transform, 80 
Zeros and poles of loss function in 
elliptic filters, 504-507 
Zeros in rational algebraic function, 
908 

Zeros of loss function in Chebyshev 
filters, 485-487 
Zverev, A. I., 802 



